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1.  INTRODUCTION 

1.1  Literature  on  Point  Processes 

Point  processes  are  models  of  random  numbers  of  events  in  time  intervals 
or  numbers  of  points  in  regions.  Here  are  some  typical  families  of  examples. 
Times  at  which  an  event  occurs:  Times  of  births,  police  emergencies, 
failures  of  a  machine,  insurance  claims,  or  earthquakes. 

Random  flows  or  streams  of  items:  Times  at  which  items  enter  or  leave  a 
certain  place  such  as  telephone  calls  arriving  to  a  switching  center,  data 
packets  entering  a  computer,  parts  leaving  a  manufacturing  work  station,  and 
caah  flows  in  a  company. 

Random  locations  of  points  in  an  Euclidean  space:  Galaxies  in  space,  errors 
in  a  computer  code,  animals  in  a  forest,  aircraft  over  a  city. 

Times  of  special  events  in  a  stochastic  process:  The  instants  when  a 
Gaussian  process  crosses  a  certain  level  or  when  a  pure- jump  Markov  process 
makes  a  certain  type  of  transition. 

Random  locations  of  elements  in  an  abstract  set:  One  can  talk  of  a  point 
process  in  which  the  points  are  functions  in  a  space  of  functions,  lines  in  a 
set  of  lines  on  the  plane,  graphs  in  a  set  of  graphs,  etc. 

Although  the  theory  of  point  processes  has  been  developed  only  recently, 
its  origins  go  back  several  centuries.  Here  are  its  major  roots. 

Poisson  Phenomena.  Poisson  (1837)  showed  that  the  Poisson  distribution  is 
the  limit  of  a  binomial  distribution  of  rare  events.  This  led  to  numerous 
applications  of  the  Poisson  distribution  in  the  nineteenth  century  and  the 
eventual  development  of  the  Poisson  process,  which  is  the  paramount  point 
process.  Two  notable  Poisson  applications,  before  the  modern  era  of 
probability,  were  Erlang's  (1909)  model  of  telephone  calls  to  a  trunk  line 
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and  Bateman's  (1910)  model  of  a-particles  emitted  from  a  radioactive 
subs  tance . 

Life-Tables.  Systems  Reliability  and  Renewal  Phenomena .  The  numerous  studies 
of  mortality  based  on  life-tables  from  Graunt  (1662)  to  Lotka  (1939),  and 
related  studies  in  this  century,  such  as  Weibull's  (1939)  study  of  system 
lifetimes,  were  the  precursors  of  renewal  processes. 

(Xieueing  in  Telecommunications.  Palm’s  (1943)  pioneering  work  on  queueing  in 
telecommunications  and  Khinchine’s  (1960)  mathematical  foundations  of 
queueing  processes  showed  the  significance  of  modeling  the  flow  of  customers 
into  a  service  station  as  a  point  process.  This  highlighted  the  need  to 
develop  point  processes  of  event  occurrences  other  than  Poisson  or  renewal 
processes. 

Statistical  Mechanics.  Gibbs'  (1902)  fundamental  work  on  statistical 
mechanics  was  a  major  catalyst  for  developing  point  processes  in  spaces  other 
than  the  real  line  and  with  interactions  among  the  points. 

Most  of  the  theory  of  point  processes  has  been  developed  in  the  last  30 
years.  The  standard  families  of  point  processes  are:  (1)  Poisson,  compound 
Poisson  and  Cox  processes.  (2)  Infinitely  divisible  and  independent 
increment  point  processes.  (3)  Renewal  processes  and  processes  defined  by 
interval  properties.  (4)  Stationary  point  processes.  (5)  Marked  point 
processes,  which  are  associated  with  each  of  the  other  families.  (6)  Point 
processes  related  to  Martingale  theory  and  stochastic  calculus. 

In  this  chapter,  I  shall  describe  the  structure  of  most  of  these 
processes  and  discuss  some  of  their  basic  properties.  The  coverage  does  not 
include  several  important  topics  requiring  lengthy  mathematical  development 
(e.g.  martingale  theory  of  point  processes,  general  Palm  probabilities,  and 


ergodic  and  spectral  analysis  of  stationary  processes).  The  emphasis  will  be 
on  presenting  tools  for  modeling  stochastic  systems  rather  than  on 
applications  of  the  tools.  Although  the  theory  of  point  processes  is 
intimately  connected  with  the  subject  of  measure  and  integration  (a  point 
process  is  a  random  counting  measure).  I  shall  focus  on  results  that  can  be 
understood  without  a  deep  knowledge  of  measure  theory.  On  the  other  hand, 
the  presentation  will  be  rigorous  and  at  the  level  of  the  applied  probability 
literature  that  one  would  encounter  in  studying  point  processes. 

The  standard  books  and  survey  articles  on  point  processes  are  as 
follows.  Introductory  works  with  a  fairly  broad  coverage  are  Daley  and 
Vere-Jones  (1972)  and  Cox  and  Isham  (1980).  One  can  obtain  a  good 
introduction  to  point  processes  by  reading  these  along  with  Cox  and  Lewis 
(1966).  Grandell  ( 1976. 1977) . .Snyder  (1975),  Jagers  (1972),  Karr  (1986, 
Chapters  1,2)  and  selected  articles  in  Lewis  (1972).  The  forthcoming  book  by 
Daley  and  Vere-Jones  (1988)  gives  a  detailed  introduction  and  more 
comprehensive  development  of  the  theory.  The  most  recent  and  rather  complete 
research  monograph  on  the  mathematical  theory  of  point  processes  and  random 
measures  is  Kallenberg  (1983). 

In  addition,  there  are  a  number  of  books  on  special  topics.  Feller 
(1971),  Cinlar  (1975),  Gut  and  Prabhu  (1987)  and  standard  introductory  texts 
on  stochastic  processes  provide  a  good  coverage  of  renewal  processes. 
Khinlchine  (1960),  Cramer  and  Leadbetter  (1967),  Franken,  Konig,  et  al . 
(1981),  Rolski  (1981),  Baccelli  and  Br£maud  (1986),  and  Neveu  (1977)  are 
studies  of  stationary  point  processes  and  queueing  (also  see  Bartfai  and 
Tomk<5  (1981)).  Matthes.  Kerstan  and  Mecke  (1978)  discuss  infinitely 
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divisible  point  processes.  The  martingale  approach  to  point  processes 
appears  in  Brdmaud  (1981).  Liptser  and  Shiryayev  (1978^,  Ikeda  and  Watanabe 
(1981),  and  Elliott  (1982).  Also.  Ripley  (1981),  Jacobsen  (1982)  and  Karr 
(1986)  study  statistical  inference  and  prediction  problems  of  point 
processes. 

Other  subjects  related  to  point  processes  are  random  sets  (Kendall 
(1974),  Matheron  (1975)  and  Ripley  (1976)),  systems  of  interacting  particles 
(Liggett  (1985)).  random  fields  (Kinderman  and  Snell  (1980)  and  Rozanov 
(1980)),  percolation  processes  (Kesten  (1982)),  and  extreme  value  theory 
(Leadbetter,  Lindgren  and  Rootzfen  (1983)). 

To  see  what  topics  lie  ahead,  consult  the  table  of  contents.  Most  of 
the  results  herein  are  proved  and  developed  further  in  Cox  and  Isham  (1980), 
Daley  and  Vere-Jones  (1988),  Feller  (1971),  and  Kallenberg  (1983).  The  other 
references  I  cite  are  for  particular  points.  For  a  complete  set  of 
references  and  a  chronology  of  the  development  of  point  processes,  see  these 
books  and  also  Karr  (1986). 

1.2  Definition  of  a  Point  Process 

The  classical  definition  of  a  point  process  on  R+  =  [0.®)  is  as  follows. 

Suppose  that  Tj.Tg....  are  random  variables  on  a  probability  space 

representing  locations  of  points  on  R+.  such  as  the  successive  times  at  which 

an  event  occurs.  Assume  that  0  <  T.  <  T„  <  ...  and  T  -*  00  a.s.  (almost 

1  ~  2.  n 

surely).  Then  the  number  of  points  or  event  occurrences  in  the  interval 
[0, t]  is  given  by 

00 

N  =  I  1  (T  <  t). 
n=l 

where  1(A)  is  the  indicator  of  A  (it  is  one  on  A  and  zero  elsewhere).  The 


counting  process  {Nt;  t  £  0}.  or  the  sequence  (T^;  n=l,2,...}.  is  called  a 
point  process  on  R+. 

This  definition  is  adequate  for  many  applications.  However,  a  more 
general  definition  is  required  for  (i)  modeling  point  processes  with  a 
finite,  random  number  of  points  (the  process  above  has  an  infinite  number), 
(ii)  defining  point  processes  on  general  spaces,  and  (iii)  characterizing  the 
probability  law  of  a  counting  process  directly  without  reference  to  its  point 
locations.  The  characterization  in  (iii)  is  needed  for  analyzing  sums 
(superpositions)  and  other  operations  on  processes,  studying  the  convergence 
of  processes,  comparing  processes  via  order  relations,  and  even  constructing 
approximations. 

We  shall  adopt  the  following  definition  of  a  point  process.  We  let  E 
denote  the  space  in  which  the. points  lie.  For  our  purposes,  we  assume  that  E 
is  an  Euclidean  space  (e.g.  R+,  R^,  [a.b],  a  countable  set),  or  a  product  of 
these  (e.g.  R+  x  C,  R^  x  C).  The  E  could  also  be  a  more  general  topological 
space,  see  Kal lenberg  (1983).  We  distinguish  three  kinds  of  subsets  of  E: 
the  class  S  of  all  intervals  or  rectangles  in  E  of  the  form  (a.b]  =  (x€E: 
a  <  x  <  b  coordinatewise} ,  the  class  £  of  Borel  sets  of  E  (those  formed  from 
countable  unions  and  intersections  of  sets  in  S) ,  and  the  class  #  of  bounded 
Borel  sets  (a  set  is  bounded  if  it  is  contained  in  a  finite  interval).  As 
usual,  all  functions  herein  are  assumed  to  be  measurable  (f:  E  -*  R  is 
measurable  if  (x:  f(x)  <  a)  €  £}  for  each  a  €  R) . 

Definition  1.1.  A  point  process  N  on  E  is  a  collection  of  non-negative 
integer- valued  random  variables  N  =  (N(A):  A££ }  on  a  probability  space  that 
take  values  in  (0,1 . <»}  and  satisfy  the  following  conditions: 

(i)  N($)=0  and  N(B)  <  00  a.s.  for  each  B€£J. 

(ii)  N(U  B^)  =  2  N(B^)  a  s'  f°r  disjoint  B^.B^,...  in  ifl. 

n  n 

The  random  variable  N(A)  represents  the  number  of  points  in  the  set  A. 


A  more  formal  but  equivalent  definition  is  as  follows.  A  count  ini 


measure  on  E  is  a  mapping  p  from  5  to  {0,1 . <»}  such  *that  p(^)  =  0; 

p(B)  <  ®.  B  €  and  p(U  B^)  =  2  p(Bn)  for  disjoint  B. ,B2, ...  in  2*.  Let  A 

denote  the  set  of  all  such  counting  measures.  Note  that  the  defining 
conditions  (i),  { i i )  above  for  N  simply  say  that  almost  every  realization  of 
N  is  a  counting  measure  on  E  (i.e.  an  element  of  A).  This  leads  to  the 
following  definition. 

Definition  1.1.  A  point  process  on  E  is  a  measurable  mapping  N  from  a 
probability  space  to  A. 

We  shall  also  use  non-integer  valued  random  measures.  A  random  measure 
A  on  E  is  a  collection  A  =  {A(A):  A€E}  of  non-negative  random  variables 
satisfying  conditions  (i)  and  (ii). 

Suppose  that  N  is  a  point  process  on  E.  Then  there  exist  random 
variables  X^.X^....  with  values  in  E  and  a  random  variable  n  with  values  in 
{0,1 . 00 }  such  that 

v 

N( A)  =  2  6X  (A).  A€£, 

n=l  n 

where  6(B)  =  l(x€B)  is  the  Dirac  measure  with  unit  mass  at  x.  The  X  's 
x  n 

represent  the  locations  of  the  points  and  v  =  N(E)  is  the  total  number  of 

points.  We  denote  this  representation  by  N  =  2U  6Y  .  We  also  let  N(a,b] 

n 

denote  N((a,b]). 

Note  that  there  are  at  most  a  finite  number  of  X  's  in  a  bounded  set. 

n 

and  the  subscripts  on  the  X^'s  may  not  be  unique.  Also.  N  may  have  several 
points  at  one  location.  When  N({x})  =  0  a.s.  for  each  x£E.  then  we  say  N  is 
simple  (a  sufficient  condition  for  this  is  in  Lemma  1.7).  If  N  is  not 
simple,  then  we  can  write 


The  covariance  measure  of  N  is 


i 
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i 
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i 
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Cov(N(  A) ,  N(B) )  =  M2(AxB)  -  p(A)p(B).  A,B€£. 

The  k-th  factorial  moment  measure  of  N  is 

|i^k)(A)  =  E[N(A)^].  A€£ ,  where  n^)  =  n(n-l) •• *(n-k) .  and 


k  k  (k  )  ( 

M(k)(Ai1x...xArr)  =  E[N(Al)  1  •••N(Ar) 


,  Aj . A^  disjoint  in  £ 


and  kj  +...+  k^  =  k.  This  uniquely  defines  p^kj(B)  for  each  B€e  .  The 
difference  between  and  is  easy  to  see  for  k=2: 

M(2)(AxB)  =  figCAxB)  -  p(ATlB),  A,B  €  £ . 

k 

Also,  if  has  a  density  f^;  E  -»  R+  so  that 

=  U  VX1 . xk)dx1-dxk. 

then,  in  comparison. 

M(k)(A)  ='V  fk(xi . VdV"dV 

where  A’  =  {(x^ . x^)  €  A:  x^.-.-.x^  are  distinct}.  The  moment  measures 


yield  infinitesimal  probabilities  in  the  usual  manner:  When  has  the 

density  f^,  then  for  distinct  x^ . x^. 

P(N(Xj  .x^+dx^]  =  1 .  N(xk.xk+dxk]  =  1)  =  f^Xj . xk)dXj .  .  . dxR. 


1.3  Distributions  and  Laplace  Functionals  of  Point  Processes 

The  distribution  or  probability  law  of  a  point  process  N  on  E  is 

uniquely  determined  by  the  joint  distribution  of  N(Bj) . NfB^).  for  each  n 

and  disjoint  Bj . B^  in  ’’ft  (called  the  finite  dimensional  distributions  of 

N).  The  following  is  an  elaboration  on  this.  We  use  =  to  mean  equal  in 
distribution. 

u 

Remarks  1.2.  Let  N  =  2  6Y  and  N'  =  2  6y .  be  point  processes  on  E  (they 

n=l  n  n=l  n 

may  be  defined  on  separate  probability  spaces). 


(a)  N  =  N*  if  and  only  if  (N(IL) . N(In))  =  (N'dj) . N'dn))  for  each  n 

and  disjoint  Ij . I  in  $  .  When  E  C  R^,  this  condition  is  equivalent  (in 

terms  of  increasing  processes)  to  (N^  . )  i  (PT  . PT  ).  t^  <...< 

1  n  1  n 


(b)  When  N  and  N'  are  simple,  then  N  =  N‘  if  and  only  if  P(N(B)  =  0)  = 
P(N(B)  =0),  B  €  aft. 

(c)  If  (u.Xj.Xg. • • • )  =  (u ' , Xj .Xg. - . . ) ,  then  N  =  N".  The  converse  is  true 

when  E  =  R  or  R  and  the  X  's  are  the  ordered  T  ‘s. 

+  n  n 

The  distribution  of  a  point  process  is  also  uniquely  determined  by  its 
Laplace  functional  as  follows.  We  shall  denote  Lebesgue  integrals  as 
/j,f(x)p(dx) ,  as  opposed  to  / ^  f(x)dp(x),  and  we  sometimes  omit  the  E. 

Readers  unfamiliar  with  these  integrals  can  interpret  them  as  Riemann 
integrals  /f(x)$(x)dx,  where  $  is  the  density  of  p  (symbolically  p(dx)  = 
<#>(x)dx).  These  integrals  also  make  sense  when  f  or  p  are  random.  An  example 


v  v 

I  f (x)N(dx)  =  2  f (X  ).  when  N  =  2  6 

E  n=l  n  n=l  n 

Definition  1.3.  The  Laplace  functional  of  a  point  process  N  on  E  is 

Lw(f)  =  E{exp[-/  f(x)N(dx)]}.  where  f:  E  -*  R  . 

E  + 

This  is  analogous  to  a  Laplace  transform  E(e  1  *)  of  a  non-negative 

random  variable  Z.  We  first  note  that  the  joint  Laplace  transform  of 

N(A  ) . N(A  ),  for  A. . A  in  E,  is  contained  in  L...  Indeed,  consider 

1  n'  1  n  N 


the  simple  function  f(x)  =  2  t,l(x€A,  ).  Then 

k=l  k 


(1.1) 


E  |exp[-  2  tkN(Ak)]}  =  l^(f). 


Thus,  L^  uniquely  determines  the  joint  distribution  of  N ( A ^ ) . N(An),  and 


so  L^  also  uniquely  determines  the  distribution  of  N.  This,  and  a 
characterization  of  N  via  integrals  are  the  subject  of  <he  next  result.  We 
let  denote  the  set  of  functions  f:E  -»  R+  that  are  continuous  and  such  that 
{x=  f(x)>0)  is  a  bounded  set. 

Theorem  1.4.  Suppose  N  and  N‘  are  point  processes  on  E.  The  following 

f)  =  1^.(0.  f  € 
d 

(iii)  /  f (x)N(dx)  =  /  f(x)N(dx).  f  €  . 

Remark  1.5.  Integrals  of  the  form  /A  f(x)N(dx),  where  A  €  £  and  f:  E  -*  R. 
are  important  in  applications  as  well  as  in  theoretical  statements  such  as 
Theorem  1.4.  A  frequently  used  formula  is 

E[/a  f(x)N(dx)]  =  /A  f (x)p(dx) . 

where  4  is  the  mean  measure  of  N.  provided  the  integral  exists.  This  is 
proved  by  verifying  it  for  simple  functions  and  then  limits  of  simple 
functions  (as  in  the  proof  of  Proposition  1.9). 

The  uses  of  Laplace  functionals  are  similar  to  those  of  Laplace 

transforms.  For  example,  moments  of  N(A^) . N(Ak)  Can  °^taine<^  from 

derivatives  of  (1.1).  As  smother  example,  suppose  . are  point 

processes  on  E.  Then  their  sum  or  superposition  N=Nj+...+Nn  is  also  a  point 

process  (regardless  of  the  dependency  among  the  N^’s).  Now.  if  N^ . are 

independent,  then  the  Laplace  transform  of  N  has  the  product  form 

1^(0  =  E{exp[-  1  /  f(x)Nk(dx)]}  =  n  Ln  (f). 

k= 1  k=l  k 

which  is  sometimes  convenient  for  obtaining  the  distribution  of  N. 

1.4  Basic  Examples:  Poisson.  Renewal  and  Stationary  Processes 

Point  processes  are  commonly  classified  by  their  distributions  (eg.  a 
compound  Poisson  process)  or  by  a  certain  characteristic  (e.g.  a  stationary 


statements  are  equivalent:  (i)  N  =  N' .  (ii)  L^( 


point  process).  They  may  also  be  classified  by  how  they  arise  as  a  function 
of  another  process  (e.g.  the  times  when  customers  exit  a  network  of  service 
systems),  by  the  mathematical  techniques  involved  in  their  analysis,  or  by 
their  application  context.  We  now  introduce  several  basic  processes. 

Suppose  N  is  a  point  process  on  E.  We  say  that  N  has  independent 

increments  if  N(B^) . N(Bn)  are  independent  for  any  disjoint  . B^  in  2* 

(we  discuss  these  processes  in  §  3.3).  We  say  that  N  is  a  stationary  point 

process  on  E  C  (or  has  stationary  increments)  if,  for  each  B^ . B^  in 

(N(Bj+x) . N(Bn+x))  i  (N^) . N(Bn)).  x  €  E. 

Here  B  +  x  =  (y  +  x:  y  €  B).  Stationary  processes  are  the  subject  of  §  5. 

The  most  important  point  process  is  the  Poisson  process. 

Definition  1.6.  A  point  process  N  on  E  is  a  Poisson  process  with  mean 
measure  A  if  N  has  independent  increments  and,  for  each  B  € 

P{N(B)  =  n)  =  A(B)ke~A(B)/n! ,  n=0. 1 , . . . 

(This  probability  statement  also  holds  for  each  B  in  the  larger  classs  S, 
with  N(B)  =  0  or  00  a.s.  when  A(B)  =  0  or  »,  respectively.)  We  call  N  a 
stationary  Poisson  process  with  rate  A  when  A(dx)  =  Adx  for  some  A  >  0  and  E 
C  R^  (the  general  process  is  sometimes  called  non-s tat  ionary  or 
non-homogeneous) . 

.  A  common  assumption  for  a  Poisson  process  N  (or  any  point  process)  is 
that  its  mean  A  takes  the  form  A(A)  =  /  A  dx,  or  A(dx)  =  A  dx;  this  A  is 
sometimes  called  the  rate  or  intensity  of  N.  Note  that  N  is  simple  if  and 
only  if  A({x})  =  0  (which  is  true  when  A  has  the  preceding  form).  In 
general,  when  A((x})  >  0,  then  N({x})  is  Poisson  with  that  mean. 

The  prominance  of  Weiner  and  more  general  Caussian  processes  is  due 


primarily  to  the  central  limit  phenomenon  that  these  processes  arise  as 
limits  of  processes  of  sums  of  random  variables  (see  for  instance  Billingsley 
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(1968)).  Similarly,  the  prominance  of  Poisson  processes  stems  from  the 
property  that  they  arise  as  limits  of  sums  of  uniformly* sparce  point 
processes  (see  Theorem  3.4).  They  also  arise  as  limits  of  processes  of  rare 
events  (see  Theorem  3.7).  Many  actual  point  processes  can  indeed  be  viewed 
as  superpositions  of  points  from  many  sources  or  as  processes  of  rare  events. 
In  addition.  Poisson  processes  are  building  blocks  for  more  complicated 
processes. 

There  are  a  number  of  characterizations  of  Poisson  processes.  The 
following  one  is  based  on  the  null  probabilities  P{N(A)  =0).  We  first 
present  a  sufficient  condition  for  simplicity  (see  p.  203  of  Jagers  (1972) 
for  the  proof ) . 

Leant  1.7.  Suppose  N  is  a  point  process  on  E  and  there  is  a  measure  A  on  E 
such  that  A({x})  =0.  x  €  E  and  P{N(B)  >  2}  =  o(A(B))  as  A(B)  -♦  0.  Then  N  is 
simple . 

Proposition  1.8.  Suppose  N  is  a  point  process  on  E  that  satisfies  the 
hypothesis  of  Leirma  1.7  and  P{N(B)  =  0}  =  e  B  €  3ft.  Then  N  is  a  Poisson 

process  with  mean  measure  A. 

Proof .  By  Lemma  1.7,  N  is  simple  and  so  by  Remark  1.2(b),  the  distribution 
of  N  is  uniquely  determined  by  the  null  probabilities  P{N(B)  =  0}.  But 
these,  by  assumption,  are  those  of  a  Poisson  process  with  mean  A. 

The  next  result  gives  an  expression  for  the  Laplace  functional  of 
Poisson  processes.  The  proof  demonstrates  a  common  approach  for  deriving 
Laplace  functionals  in  general.  We  shall  return  to  Poisson  processes  in  the 
next  section. 


Proposition  1.9.  If  N  is  a  Poisson  process  with  mean  measure  A  then 


LN(f)  =  exp[-/( 1-e 


•f(x) 


)A(dx) ] . 


v% 
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Proof.  Denote  the  right  side  by  C(f).  First,  consider  the  simple  function 


f(x)  =  2  t^l(x€B^).  where  Bj . B^  are  disjoint  in  ft"  Since 

k=l 


N(Bj) . N(Bn)  are  Poisson  variables. 

n  n  "tkN{Bk) 

LN(f)  =  E{exp[-  2  ^(1^)]}  =  IT  E[e  k  k  ] 


=  17  exp[-A(B  )(l-e  K)]=C(f). 

k=l 


Next,  consider  a  function  f  such  that  {x:  f(x)  >  0}  €  ft.  We  can  write  f(x)  = 


lim  f  (x).  x  €  E.  where  the  f  's  are  simple  functions  as  above.  Then  by  two 
__  nx  n  J 


applications  of  the  dominated  convergence  theorem  and  the  preceding  result. 


we  have 


L»i(  f )  =  lim  LN(f  )  =  lim  G(f  )  =  C(f) 


Finally,  consider  any  function  f.  and  let  B^  be  a  sequence  in  ft  such  that 


B^  t  E.  Define  f^(x)  =  f  ( x )  1  ( X.C  ) .  and  so  {x'-  fn(x)  >  0}  €  ft.  Then  the 


preceding  equalities  hold  by  two  applications  of  the  monotone  convergence 


theorem. 


For  point  processes  on  R+  or  R.  it  is  common  to  specify  their 


distributions  by  specifying  the  distributions  of  their  point  locations  or 


their  inter-point  distances.  The  primary  example  is  the  renewal  process. 


Definition  1 . 10.  Let  N  =  2  6^,  be  a  point  process  on  R+ ,  and  let  =  T^ 

n=  1  n 


and  Wn  =  Tn  -  T  .  n=2.3, . . .  The  N  is  a  renewal  process  with  waiting  time 


d i s  t  r i bu  t i on  F  if  Wj.Wg....  are  independent  and  each  one  has  the  distribution 


F.  For  simplicity,  we  assume  that  F(0)  =  0,  and  so  N  is  simple.  We  call 


Tj  <  <  ...  the  renewal  times  of  N  and  Wj . W^. . . .  the  waiting  times  between 


renewa 1 s 


m mmmm 


vv\pw 
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Reaark  1.11.  The  distribution  of  a  renewal  process  is  uniquely  determined  by 
its  waiting  time  distribution.  To  see  this,  suppose  N  and  N'  are  two  renewal 
processes.  By  Remark  1.2(c)  we  know  that  N  =  N'  if  and  only  if  (T^.Tg....) 

(Tj.Tg _ )•  But  the  latter  is  equivalent  to  (Wj.Wg....)  =  (Wj.Wg....)  which 

is  equivalent  to  F  =  F'.  Thus  N  =  N'  if  and  only  if  F  =  F’.  This  uniqueness 
property  is  used,  for  instance,  in  stochastic  comparisons  or  convergence 
resu 1 ts. 

Although  renewal  processes  have  a  simple  structure,  their  Laplace 
functionals  generally  do  not.  We  shall  continue  our  discussion  of  renewal 
processes  in  §4. 

1.5  Marked  and  CoiqxHind  Point  Processes 

In  addition  to  their  locations,  the  points  of  a  point  process  may  have 

distinguishing  attributes  or  attendant  information,  which  are  commonly  called 

marks.  The  standard  way  of  modeling  marks  is  as  follows. 

u 

Consider  a  point  process  N  =  2  6  on  E.  Suppose  that  associated 

1A 

n 

with  the  point  at  X  (n  <  u)  there  is  a  mark  Z  that  takes  values  in  some 

n  v  '  n 

space  E' .  Then  the  point  process  M  on  ExE'  defined  by 

v 

M(AxA)  =  I  1 (X  €  A,  Z  €  A).  AxA ’  €  Sxg' 

n=l  ‘ 

represents  the  marks  as  well  as  the  point  locations. 

Before  we  formalize  this  notion  of  marked  point  processes,  consider  the 

special  case  in  which  the  marks  Z^  are  conditionally  independent  given  N  and 

a  mark  for  a  point  at  x  has  the  conditional  distribution  K(x,dz)  (often 

called  a  kernel);  that  is,  for  A, . A  in  S'. 

’  1  n 

n 

P(Z,  €  A. . Z  €  A  |N.  u  >  n)  =  IT  K(X.,A.). 

v  1  1  n  n  J=1  J  J 


n  a 


15 


' 

In  ocher  words,  the  mark  at  =  x,  when  u  >  n.  depends  on  N  only  through 
, „  x.  Then  the  Laplace  functional  of  M  is  as  follows. 

i 

Leaaa  1. 12.  For  f :  E  x  E’  -*  R+, 

i  ‘  4(0  =  405). 

where  g(x)  =  -log  / £.  e  ^X,Z^K(x.dz). 

Proof.  Since  the  ’s  are  conditionally  independent  given  N.  therefore 

4(0  =  E{E[exp(-  2  f(Xn.Zn))(N]} 
n=l 


v 

e{  n  e 

n=l 


-f(X  ,Z  ) 

>  n  n  |N. 


v  >  n 


=  E{exp 


-  2,^Xn> 

n=l 


}  =  4(g) 


We  are  now  ready  for  our  definition. 

Definition  1.13.  Suppose  N  is  a  point  process  on  E  and  M  is  a  point  process 
on  E  x  E'  such  that  N(A)  =  M(AxE'),  A  €  S.  We  call  M  a  marked  point  process 
of  N.  Furthermore,  we  say  that  M  has  location-dependent  marks  with 
distribution  K(x,dz)  if  the  Laplace  functional  of  M  is  as  in  Lemma  1.12. 

Keep  in  mind  that  a  typical  representation  of  a  marked  point  process  is 


H  =  I  ^  where  N  =  2  6^  .  If  M  has  location-dependent  marks  <i 

n=l  n’  n  n=l  n 


distribution  K(x,dz).  then  the  mean  measure  of  M  is  (recall  Remark  1.5), 
E[M(AxA ' ) ]  =  E{E[M(AxA' ) |N] }  =  E{ /  K( x. A‘ )N(dx) }  =  /  K(x . A ' )p(dx) , 
where  p  is  the  mean  measure  of  N.  That  is,  EM(dxdz)  =  K(x .dz)p(dx) . 
Moreover,  for  f:  ExE'  -»  R, 

E[/a  /a.  f (x.z)M(dxdz) J  =  /A  /A.  f(x,z)K(x,dz)p(dx). 


NLvrjtf 


■I 
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If  N  is  a  point  process  on  R+  with  marks  that  are  real-valued  (or  are 
vectors  or  elements  of  a  semigroup),  then  these  marks  are  often  modeled  by 
the  cumulative  process 

Z(t)  =  2  Znl(Tn  <  t).  t€R+. 

n=l 

Alternate  representations  are 

.  N. 

Z(t)  =  /  /  z  M(dxdz)  =2  Z  . 

0  E‘  n=l  n 

This  process  provides  the  same  information  as  the  marked  process  M. 

Example  1.14  Marks  as  Functionals  of  a  Stochastic  Process.  Suppose  Y  =  (Y  : 

t  £  0}  is  a  real-valued  regenerative  process  over  the  times  0  <  Tj  <  < • . • 

(see  §  4.1).  A  typical  mark  of  might  be  the  discounted  cost 

T 

Zn  =  /T"  e_at 
n-1 

where  c(y)  is  the  cost  per  unit  time  of  Y  being  in  state  y.  Then  the 
cumulative  process 

Nt  TN 

Z( t)  =  2  Z n  =  /  c  e  as  c(Ys)ds 

n=l  0 

is  the  discounted  cost  in  the  interval  [O.T^  ].  This  and  a  variety  of  other 

t 

marks  are  functionals  of  the  form 


Another  example  is 


Z  =  *(T  . ,  T  .  { Y  •  t€(T  ,T  ]}). 

n  '  n-1  n  t  'n-1  nJ,y 


Z  =  max( Y  :  t€(T  ,.T  ]}. 
n  t  '  n-1  nJ' 


In  situations  where  points  occur  in  batches,  an  appropriate  model  might 
be  a  compound  point  process  defined  as  follows. 

Definition  1.15.  Suppose  N  is  a  point  process  on  E  and  M  is  a  marked  point 
process  of  N  on  Ex{0,l....}  with  location-dependent  marks  having  distribution 
K(x.dz).  The  point  process 


K 

i 


m 


m 


N ' (A)  =  /  /  z  M(dxdz)  =  2  Z  6  (A).  A€£, 

A  E*  n=l  n  n 

is  a  compound  point  process  of  N  with  mass  distribution  K(x,dz).  The  term 
compound  has  traditionally  been  used  only  for  location-independent  marks 
where  the  Z^'s  are  independent  of  N.  For  instance,  when  N  is  a  Poisson 
process  with  mean  A  and  K(x.dz)  =  F(dz)  independent  of  x.  then  N’  is  a 
compound  Poisson  process  whose  points  have  the  mean  measure  A  and  mass 
distribution  F.  (This  N‘  is  a  compound  Poisson  random  measure  when  the  Z^’s 
are  real-valued  instead  of  integer-valued.) 

Similar  to  Lemma  1.12.  the  Laplace  functional  of  the  compound  point 
process  N‘  is 


L^.(f)  =  Lj^(h).  where  h(x)  =  -  log  2  e  z^(x)|<(x.  (z } )  . 
1  z=0 

and  that  for  the  compound  Poisson  process  N'  is 


LN.(f)  =  exp 


00 

-/„  2  (1  -  e~zf(x)A(dx)F({z}) 


z=0 


(1.2) 
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2.  POISSON  PROCESSES  AND  SOME  RELATIVES 

In  this  section,  we  characterize  the  structure  of  Poisson  processes  and 
discuss  several  operations  on  them  including  sums,  partitions,  thinnings  and 
translations.  We  also  give  brief  descriptions  of  sample  processes,  Cox 
processes,  negative  binomial  processes  and  cluster  processes. 

2.1  Characterization  of  Poisson  Processes 

The  following  results  show  how  the  distributions  of  the  counting 

variables  for  a  Poisson  process  determine  the  distributions  of  its  point 

locations.  Stationary  Poisson  processes  on  R+  or  R  are  especially  nice. 

Theorem  2.1.  Suppose  N  is  a  stationary  Poisson  process  on  R+  with  rate  A. 

Then  the  interpoint  distances  Wj.W^. ...  are  independent  exponentially 

distributed  with  mean  A  *  and- the  location  of  the  nth  point  T  =  iP  ,W,  has  a 

n  k=l  k 

gamma  distribution  with  order  n  and  scale  parameter  A. 

Proof .  By  the  definition  of  a  Poisson  process,  it  follows  that,  for  each  n 
and  t  >  0. 

P(wn+l  >  t|wi . V  =  P{N(Tn-Vt]  =  0|Tn-  N(B)-  BC(°'TJ} 


=  P{N[(0. t]  =  0}  =  e  . 

Using  this  in  an  induction  argument  proves  the  assertion  about  the  W  ’s.  The 

n 

gaitma  distribution  of  is  a  standard  consequence. 

The  preceding  result  and  Remark  1.12(c)  yield  the  following 
characterization^  A  renewal  process  is  a  Poisson  process  if  and  only  if  its 
waiting  time  distribution  is  exponential. 

The  next  result  characterizes  the  point  locations  of  Poisson  processes 
on  general  spaces. 


Theorem  2.2.  A  point  process  N  on  E  is  a  Poisson  process  with  mean  measure  A 

if  and  only  if.  for  each  B  €  B.  the  process  N  on  B  is  equal  in  distribution 

to  a  point  process  N'  =  5^  on  B,  where  u.Uj.Ug,..-  are  independent 

n 

random  variables  such  that  u  has  a  Poisson  distribution  with  mean  A(B)  and 

each  U  takes  values  in  B  and  has  the  distribution 
n 

F( A)  =  A(A)/A(B) .  ACB. 

Proof.  It  suffices,  by  Theorem  1.4.  to  show  that  N'  has  the  Poisson  Laplace 
functional  shown  in  Proposition  1.9.  But  this  follows  since,  by  the 
properties  of  u.U^.Ug .  we  have 

1^.(0  =  E(E{exp[-  2  f(Un)]|u})  =  E([/  e"f(x)  F(dx)]U) 

n=l 

=  exp{-A(B)[l-/  e'f(x)F(dx)]}  =  exp[-/( l-e~f(x) )A(dx) ] . 

This  result  says  that  on  a  bounded  set  B.  the  Poisson  number  of  points 
N(B)  are  located  as  a  random  sample  U^.U^, ...  from  the  distribution  F.  This 
characterization  is  useful  for  deciding  whether  a  Poisson  process  is  an 
appropriate  model  for  a  certain  phenomenon.  It  is  also  useful  for 

d  U 

applications;  note,  for  instance,  that  /g  f(x)N(dx)  =  2  f ( ) . 

n=  1 

Remark  2.3.  For  a  point  process  on  R+,  the  preceding  result  is  usually 

expressed  as  follows.  Suppose  that  N  is  a  Poisson  process  on  R+  with  mean  A 

and  point  locations  0  <  Tj  <  T^  <  • ■ ■  Then,  for  a  given  t  >  0.  the 

conditional  distribution  of  T, . T  given  N  =  n  is  equal  to  the 

1  n  t 

distribution  of  the  order  statistics  U, ,  ,  <  U,„.  <  ...  <  U.  .  of  U. . U 

(I)  '  (2)  -  "  (n)  1  n 

that  are  independent  with  distribution  F(s)  =  A^/A^,  0  <  s  <  t.  That  is.  for 

0  <  t.  <  u.  <  . . .  <  t  <u  <t, 

11  n  n 


20 


(2.1) 


P<T, e  . T„e 


=  nf(A  -  A  )...(A,  -  A  ). 
'  t ,  u  '  v  t  u  ' 
In  n  n 


When  Asds.  this  distribution  has  the  density 

f-r  tIu  (t . t  )  =  n!A  ...A  /A(t) 

1  n 1  t  In 


For  the  special  case  when  N  is  stationary  with  rate  A.  then  U. . U  are 

1  n 


uniformly  distributed  on  [O.t],  and  the  last  conditional  density  reduces  to 


n!/tn. 


Another  immediate  consequence  of  Theorem  2.2  is  as  follows.  Suppose  N 


is  a  Poisson  process  on  E  with  mean  A.  Then  for  each  n.  B  €  B,  disjoint 


Aj . A^  in  &  and  n^+.  .  ,+nj^  =  n. 


nl  "k 


(2.2)  P{N(  Aj )  =  ni . N(AjP  =  nk|N(B)  =  n}  =  ~  —  n  y  p/... 


where  p.  =  A(A.)/A(B).  This  is  the  multinomial  probability  that  n^ . n^ 


points  in  the  sample  Uj . fall  in  the  respective  sets  A^ . A^  where 


p.  =  P(U  €  A.). 

*1  v  m  l ' 


2.2  Sample  Processes 


The  order  statistic  property  of  Poisson  processes  in  Theorem  2.2  is 


characteristic  of  the  following  important  family  of  finite  point  processes. 


Suppose  X1>X<2 _  are  independent  random  variables  that  take  values  in  E 


and  each  one  has  the  distribution  F.  Then  N  =  2  6Y  is  a  point  process  on 

k-l  xk 


E  wi  th 


L„(  r>  =  F.{cxp  -  2  r(\)]}  =  t/E  e"r(x|F(dx)]". 


B 


«  _•  •  /  .*  /  ••  i 


Any  point  process  on  E  that  is  equal  in  distribution  to  N  (or  lias  the 

preceding  Laplace  functional)  is  called  a  sample  process  on  E  with  mean 

measure  nF.  Now,  suppose  v  is  a  non-negative  integer-valued  random  variable 

independent  of  N.  Then  N'  =  2U  6Y  is  a  point  process  on  E  with 

k=l  k 

4.(0  =  C(/E  e"f(><)F{dx)).  where  C(s)  =  E(s”). 

Any  point  process  on  E  that  is  equal  in  distribution  to  N'  is  called  a  mixed 
sample  process  with  mean  measure  EnF  (N‘  is  N  with  o  randomized  and  hence  is 
a  mixture  of  N) . 

Example  2.4.  A  Dispatching  Model.  Suppose  that  a  random  number  u  of  items 

(e.g.  parts  or  data  packets)  arrive  at  a  station  in  a  fixed  time  interval 

[O.T].  The  times  at  which  the  items  arrive  are  independent  with  distributin 

F,  and  are  independent  of  v.  At  fixed  times  0  =  t_  <  t .<...<  t  =  T,  the 

0  1  n 

accumulated  items  are  instantaneously  dispatched  from  the  station.  Then  the 
total  waiting  time  of  the  items  at  the  station  up  to  time  T  is 

n-1  Ck+1 

W(t. . t)  =  2  /  N(t  t  +  u]du. 

1  n  k=0  k  k  K 

where  N  is  the  mixed  sample  process  defined  above.  Note  that 

n=l  tk+l 

EW(t . t  )  =  Eu  2  /  [F(t  +u)  -  F(t  )]du 

1  n  k=0  k  k  k 

(the  expectation  can  be  taken  inside  the  integral  by  Fubini’s  theorem).  This 

expression  can  be  used  to  optimize  the  dispatch  times  t^ . t  and  the 

number  n  of  dispatches  as  well.  For  instance,  if  there  is  a  cost  c  for  each 
dispatch  and  a  cost  h  per  unit  time  for  holding  each  item,  then  the  problem 
is 

min  {cn  +  hE[W(tj . Cn^’ 


For  the  case  in  which  N  is  a  stationary  Poisson  process  with  rate  A,  one  can 
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2.3  Sums,  Partitions,  Thinnings  and  Translations  of  Poisson  Processes 

Some  standard  operations  on  point  processes  are  summing  of  processes, 
partitioning  a  process  into  several  subprocesses,  thinning  (deleting)  points 
in  a  process,  and  translating  the  points  in  a  process.  We  shall  now  discuss 
these  operations  for  Poisson  processes. 

We  first  observe  that  a  sum  of  independent  Poisson  processes  is  also 
Poisson. 

Theorem  2.6.  If  N, . N  are  independent  Poisson  processes  on  E  with 

1  n 

respective  mean  measures  A,,..., A  .  then  N  =  N.+...+N  is  a  Poisson  process 

In  In 

with  mean  measure  A  =  A.+...+A  . 

1  n 
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Proof .  This  follows  immediately  from  the  defining  properties  of  a  Poisson 


process.  Another  approach  is  to  observe  that 


n  n  r 

4,(0  =  It  4  (f)  =  JI  exp  -  /(1-, 
k= 1  k  k=l 


e  f^X^)Ak(dx) 


=  exp 


-  /( 1 -e  f(x))A{dx)  . 


This  result  extends  to  infinite  sums  N  =  I  N,  when  A(B)  <  00  for  B  €  B. 

k=0  k 


It  also  holds  for  other  families  of  processes  including  stationary.  Cox 


(§2.4).  infinitely  divisible  and  independent  increment  processes  (§  3.3).  and 


mixed  sample  processes  with  a  common  sample  distribution.  On  the  other  hand. 


it  does  not  hold  for  renewal  processes  or  stationary  interval  processes 


(§  4.5). 


A  large  class  of  marked  point  processes  of  Poisson  processes  are  also 


Poisson. 


Proposition  2.7.  Suppose  N  is  a  Poisson  process  on  E  with  mean  A  and  M  is  a 


marked  point  process  of  N  on  E  x  E'  with  position-dependent  marks  having 


distribution  K(x.dz).  Then  M  is  a  Poisson  process  with  mean  measure 


A(dx)K(x.dz) 


Proof.  This  follows  since  Proposition  1.9  and  Lemma  1.12  yield 


4,(0  =  4,(g)  =  exp  -  J(l-e'g(x))A(dx) 


=  exp 


"  ^ExE' 


(1  -  e'f(x,z))  A(dx)K(x. dz )  . 


We  now  discuss  partitions  and  thinnings  of  a  point  process  N  on  E.  By  a 


irtition  of  N  we  mean  any  collection  of  point  processes  . on  E  such 


that  N  =  Nj+.-.+N^.  Typically.  N  is  a  "parent"  process  and  each  of  its 


points  is  assigned  randomly,  by  some  rule,  to  one  of  the  subprocesses 


y  y  .  V-y 

'"VcVvV..  V  .'vVV’ 


•f 


'  "'V 


N, . N  .  There  is  a  one-to-one  correspondence  between  partitions  N . N 

In  In 

of  N  and  marked  point  processes  M  of  N  on  Ex{l . n};  namely, 

u 

Nk(A)  iH(Ax{k})  =  2  1(X  €A.  Zn=k),  ACE,  k=l . n. 

K  n=l  n  n 

The  mark  indicates  the  subprocess  to  which  the  point  at  X^  is  assigned. 

As  an  example,  suppose  X^  <  X^  <  ...  are  times  at  which  data  packets  enter  a 

computer  data  base  consisting  of  n  files  and  Zj.Zg,...  are  the  respective 

files  to  which  the  packets  are  sent.  Then  models  the  number  of  packets 

entering  file  k  over  time.  Analogous  partitions  depict  multiple  customer 

flows  in  queueing  networks,  part  flows  in  manufacturing  systems,  and  demand 

occurrences  in  economic  markets.  In  some  cases  the  partitioning  rule  is 

implicit:  If  each  point  of  N  has  one  of  n  attributes,  then  N, . N  can 

1  n 

serve  as  models  of  the  numbers  of  points  with  these  respective  attributes. 

The  notion  of  thinning  of  the  point  process  N  refers  to  the  operation  of 
randomly  deleting  some  of  its  points.  In  general,  a  point  process  N'  on  E 
such  that  N‘(A)  <  N(A),  A  €  E,  is  called  a  thinning  of  N  (N‘  is  a  thinner 
version  of  N).  Any  subprocess  in  a  partition  of  N  is  a  thinning  of  N. 

We  shall  consider  the  following  basic  partitions  and  thinnings.  We  say 

that  Nj . is  a  partition  of  N  based  on  the  probabilities  p^(x) . p^fx) 

if  a  point  of  N  at  x  is  assigned  to  subprocess  with  probability  pk(x) 
independent  of  everything  else  (i.e.  Zj.Zg....  are  position-dependent  with 
distribution  pk(t)  =  P,  {Z^=k  |  X^=x,  n>u}  .  Similarly,  we  say  that  N'  is  a 
p(x)  -  thinning  of  N  if  a  point  of  N  at  x  is  retained  (assigned  to  N')  with 
probability  p(x)  independent  of  everything  else. 


Theorem  2.8.  Suppose  N  is  a  Poisson  process  on  E  with  mean  A.  If  N. . N 

I  n 

is  a  partition  of  N  based  on  the  probabilities  p^(x) . Pn(x),  then 

Nj . are  independent  Poisson  processes  with  respective  mean  measures 


Pj(x)A(dx) . Pn(x)A(dx).  Hence,  if  N‘  is  a  p(x)-thinning  of  N,  than  N‘  is 

a  Poisson  process  with  mean  measure  p(x)A(dx). 

Proof .  Let  M  be  the  marked  point  process  on  E  x  {l.....n}  such  that 
N^(A)  =  M(A  x  {k}).  Since  N  is  Poisson.  Proposition  2.7  implies  that  M  is 
also  Poisson  with  mean  EM(dx  x  {k})  =  p^(x)A(dx).  Thus  each  is  Poisson 

with  mean  p^,(x)A(dx).  Moreover,  . are  independent  since  they  are  the 

restriction  of  the  Poisson  process  M  to  the  disjoint  sets  E  x  {1} . E  x{n} , 

respectively. 

Example  2.9.  Non-s tat  ionary  Poisson  Processes  as  Time  Transformations  or 
Thinnings  of  Stationary  Processes.  Let  N  be  a  Poisson  process  on  R+  with 
mean  Af  =  /q  A^ds.  Let  be  a  stationary  Poisson  process  on  R+  with  rate  1. 
and  let  N^o  A  denote  the  point  process  on  R+  defined  by  N^o  A(a.b]  = 

Nl(Aa  ,A^],  a  <  b.  Clearly  Nj*o  A  has  independent  increments  and  N^o  A^  is 
Poisson  with  mean  At-  Therefore,  N  =  N(  o  A.  That  is,  N  is  a  time 
transformation  of  the  stationary  Poisson  process  Nj.  Another 
characterization  of  N  is  as  follows.  Consider  N  on  E  =  [0,T]  where  Ay  <  «® 
and  let  N'  be  a  p(x)  -  thinning  of  with  p(x)  =  A^/Ay,  0  <  x  <  T.  then 
Theorem  2.8  yields  N  =  N'.  This  representation  is  convenient  for  simulations 
of  N  (Lewis  and  Shedler  (1979)).  One  need  only  generate  points  of  on  E, 

say.  Tj . T^  and  then  retain  the  point  at  T  with  probability  p(T^).  The 

resulting  points  constitute  N.  This  procedure  requires  the  evaluation  of 
only  Ay  /Ay,  j  =  l . n,  (the  integral  A^  need  not  be  evaluated  as  in  the 

j 

time-transformation  characterization).  Note  that  this  procedure  can  also  be 
used  for  E  C  R^ . 

Another  common  operation  on  a  point  process  is  a  random  translation  of 
its  points.  Suppose  N  is  a  point  process  on  E  and  E  is  closed  under  addition 


(x  +  z  €  E  for  each  x.z  €  E) .  Suppose  N'  is  a  point  process  on  E  of  the 
form. 


N(A)  3  /  1 (x+z€A)M{dxdz)  =  2  1(X  +Z  CA).  ACE, 


where  M  =  ^  6^  2  is  a  marked  point  process  of  N  on  E  whose  marks  are 

n'  n 

independent  with  distribution  F.  That  is,  N'  is  the  process  N  with  each 

point  at  x  translated  a  random  distance  with  distribution  F  (i.e.  X^  is 

translated  to  X  +Z  ).  From  Lemma  1.13,  we  have 
n  n' 

LN.(f)  =  E^exp /^2f(x+z)M(dxdz)J|  =  L^(g) 

where  g(x)  =  -  log  /^..e  F(dz).  Here  is  a  special  case. 

Theorem  2.10.  If  N  is  a  Poisson  process  with  mean  measure  A.  then  its 
translated  version  N‘  defined  above  is  a  Poisson  process  with  mean  measure 
A‘(A)  =  /eA(A-z)  F(dz) . 

Proof .  This  follows  since  a  substitution  of  the  Poisson  Laplace  functional 
L^  in  the  preceding  expression  yields 

1^.(0  =  exp  -  /  2(1  -  e_f(x+z))F(dz)A(dx)] 


=  exp  -  /£(  1  -  e  f^)A‘(dy) 


2.4  Cox  Processes 

One  can  construct  natural  generalizations  of  random  variables  by 

randomizing  their  parameters.  For  example,  a  random  variable  with 

distribution  P(X  i  x)  =  f°  (1  -  e  ^X)F(dX)  is  called  an  F-mixture  of 

0 

exponential  distributions  or  an  exponential  random  variable  with  a  random 
parameter  that  has  the  distribution  F.  This  procedure  of  randomizing 
parameters  also  extends  to  stochastic  processes  (recall  the  mixed  sample 
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process).  Another  primary  example  is  the  Cox  process:  a  Poisson  process 


with  randomized  intensity. 


Definition  2.11.  Let  N  be  a  point  process  on  E  and  A  be  a  random  measure  on 


E  (not  necessarily  on  the  same  probability  space  as  N).  The  N  is  a  Cox 


process  directed  by  A  if.  for  each  . n^  and  disjoint  A^ . Ak  in  E, 


P<N(A1)  =  . N(Ak)  =  ry  =  E  fT^  A(AJ) 


n  .  -A  .(A  .) 

Je  J  J  /n  »  . 


This  is  equivalent  to 


LN(f)  =  E^exp  [-  /£  (1  -  e~f{x))A(dx)]|. 


Cox  (1955)  introduced  this  process,  which  is  sometimes  called  a  doubly 


stochastic  Poisson  process,  a  conditional  Poisson  process,  or  a  Poisson 


process  in  a  random  environment. 


As  an  example,  suppose  N  is  a  point  process  on  R+  that  represents  the 


number  of  failures  over  time  of  a  robot  in  a  manufacturing  plant.  The  robot 


makes  several  types  of  parts  and  when  it  is  used  on  a  job  of  type  u.  its 


number  of  failures  is  a  Poisson  process  with  constant  rate  a(u). 


Consequently,  if  the  production  schedule  were  specified  by  a  non- random 


function  u(t),  then  N  would  be  a  Poisson  process  with  mean  measure 


At  =  /q  a(u(s))ds.  Suppose,  however,  that  the  production  schedule  is  a 
stochastic  process  {U^;  t  >  0}  that  is  not  affected  by  the  failures.  Then 
the  failure  process  N  is  a  Cox  process  directed  by  A.  where  A^  =  afU^Jds. 


t  >  0. 


Since  Cox  processes  are  essentially  Poisson  processes,  each  result  for 


Poisson  processes  generally  has  a  counterpart  for  Cox  processes.  Some 


elementary  properties  of  Cox  processes  are  as  follows  (see  Brdmaud  (1981), 


Grandell  (1976),  Karr  (1986),  and  Synder  (1975)  for  further  discussion). 


Here  N  is  a  Cox  process  directed  by  A. 


£ 

i« 

V 
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(a)  EN( A)  =  EA(A) ,  VarN(A)  =EA(A)  +  VarA(A) 

V](A1 . V  =  £[*!<*!>  W] 

(b)  N  is  simple  if  and  only  if  A({x})  =  0  a.s..  x  €  E. 

(c)  N  is  stationary  if  and  only  if  A  is  stationary  (the  definition  being 
similar  to  that  for  point  processes).  When  A(A)  =  /  X  dx,  then  A  is 

A.  X 

stationary  if  and  only  if  (X^:  x€E}  is  a  stationary  process  (cf.  S5.1). 

(d)  When  E  =  R+.  then  N  =  o  A.  recall  Example  2.9.  where  is  a 
stationary  Poisson  processes  with  rate  1  independent  of  A. 

(e)  The  Poisson  results  in  the  preceding  sections  readily  extend  to  N.  For 

instance,  if  . is  a  partition  of  N  based  on  the  probabilities 

Pj(x) . Pn(x).  then  each  is  a  Cox  process  directed  by  p^(x)A(dx) 

and  Nj . are  conditionally  independent  given  A. 

Example  2.12.  Negative  Binomial  Processes.  Let  N  be  a  Cox  process  on  E 
directed  by  A.  Suppose  A  =  Yp.  where  p  is  a  non-random  measure  on  E  and  Y  is 
a  random  variable.  Such  a  Cox  process  is  sometimes  called  a  mixed  Poisson 
process.  Then  the  Laplace  functional  of  N  reduces  to 

LN(f)  =  *(/E  (1  -  e  f^)  p(dx) ) .  where  *(s)  =  E(e  SY) 

Now  consider  the  special  case  in  which  Y  has  a  gamma  distribution  with 
♦( s)  =  ( 1+s)  r .  Then 

LN(f)  =  1  ♦  fE  (1  -  e"f{x))  p(dx)  "r. 

In  particular,  for  Aj,...,A^  in  E. 

E{«*P  [  -  ■„»(*„)]}  .  [p/(l  -  qr.r)]r  tk  £  [0.1], 

r  n  i-i 

where  p  =  ^I  +  X(  U  A.)J  and  =  pX(A^).  This  is  the  multivariate 

laplace  transform  of  the  n-dimensional  negative  binomial  distribution  with 
parameters  n.p.q^ . q^.  That  is.  the  finite  dimensional  distributions  are 


29 


i 
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negative  binomial.  Accordingly.  N  is  called  a  negative  binomial  point 
process  (Gregoire  (1983)  and  Diggle  and  Milne  (1983)).* 

The  preceding  is  not  the  only  type  of  negative  binomial  process.  Here 

U) 

is  another  one.  Let  N  =  2  _ ^  ^  a  compound  Poisson  process  on  E  whose 

"  n 

Poisson  points  have  mean  A  and  whose  masses  have  the  probability  density 

P(Zn  =  m)  =  (pm/m)  log[  l/(  1  — p )  ]  .  nt=1.2 .  where  0  <  p  <  1.  Then  from 

(1.2).  we  have 

{CD 

-  I  /E(l  '  e‘mf{x))A(dx)(pm/m)log[l/(l-p)] 
m=l 

=  exp  /  log  [(1  -  pe  f^)/(l  -  p)]/log(  l-p)A(dx) . 

In  particular,  for  disjoint  . A^. 

E{e,tp[ '  J,  'kN<V 

Again,  this  is  an  n-variate  negative  binomial  Laplace  transform.  In  this 
case.  N  has  independent  increments,  which  was  not  true  for  the  preceding 
example. 

2.5  Poisson  Cluster  Processes 

Let  N  =  6^  be  a  point  process  on  E.  Suppose  there  are  point 

n 

processes  Nj . on  some  space  E'  representing  clusters  of  points 

associated  with  the  respective  points  X. . X  ,  and  tliat  lv  .  N  (B)  <  B 

1  u  n=l  nv  ' 

€  B.  Then  N'  =  is  a  point  process  on  E’  representing  the 

superposition  of  the  clusters.  Suppose,  in  addition,  that  . N(  are 

posi  t  ion -dependent  marks  of  X^ . X()  with  distribution 

K(x.A)  =  P(N  C  A  |  X  =  x,  v  >  n), 

1  n  n  ~ 


n  -A(A  )/log( 1  -  p) 

-  n  C(i  -  P)/(1  -  Pt.  )]  J 
k=l  K 


for  A  Bore  1  in  A ' , 
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where  A'  is  the  set  of  all  counting  measures  p  on  E’  .  Then  the  Laplace 
functional  of  a  single  cluster  is 


L(f;x)  =  E{exp /£. f(y)Nn(dy) 


|  X  =  x.  u  >  n} 
1  n  -  1 


~  fjT  exppE'f(yMdy) 


K(x.dp). 


Furthermore. 


^.(f)  =  ^{e [exP( ~  2  /E.f(y)Nn(dy))  |  n]} 


=  e|  L(f;  Xn)|  =  Ejexp  log  L(f;Xn)}. 

Thus , 

LN  (f)  =  L^g)  where  g(x)  =  -  log  L(f;x). 

A  point  process  N‘  whose- distribution  has  a  Laplace  functional  of  this 
form  is  called  a  cluster  process  of  N  whose  clusters  have  distribution 
K(x,dp).  We  call  N'  a  Poisson  cluster  process  when  the  parent  process  N  is 
Poisson.  In  this  case. 

LN.(f)  =  exp|  -  /E.  /^.(l  -  e'^f{y)M(dy))K(x.dp)A(dx)} 
where  A  is  the  mean  of  N.  Note  that  any  point  process  of  the  form 


N ‘ (A)  =  /  m(A)  M(dxdp) 

ExA ' 


is  a  cluster  process  of  N  when  M  is  a  Marked  point  process  on  ExA'  of  N  with 
loca t ion -dependent  marks  with  distribution  K(x.dp).  Note  that  a  compound 
Poisson  process  is  a  special  case  of  a  Poisson  cluster  process. 


Exaaple  2.13.  Neyman-Scott  Cluster  Process.  Suppose  N  is  a  stationary 


Poisson  process  on  E  =  R  with  rate  A  whose  point  locations  represent  cluster 
centers.  Associated  with  a  center,  say  at  x.  there  is  a  cluster  of  ()  points 
whose  distances  from  x  are  independent  and  identically  distributed  and  ft  is  a 


a 


31 


random  variable  independent  of  x  and  the  distances.  In  other  words,  a  single 
cluster  process  centered  at  x  is  equal  in  distribution  *to  the  mixed  sample 
x  P 

process  N  =  2  6  y  .  where  0.Y are  independent  and  each  Y,  has  the 

k=l  k  1  k 

distribution  F.  Let  N'  denote  the  sum  of  these  single  clusters  centered  at 
the  point  locations  of  N.  Then  N‘  is  a  Poisson  cluster  process  whose 
clusters  have  the  Laplace  functional  (recall  5  2.2) 

L((;x)  =  E{exp[-  /E.f(y)Nx(dy)]} 

=  C(/E  <fr<~»>F(d,» 

where  G(s)  =  E(s^). 

See  Cox  and  Isham  (1980)  for  further  discussion  of  this  and  other 
cluster  processes.  Also.  Serfozo  (1984a)  shows  that  a  Cox  process  may  be  a 
good  approximation  for  a  cluster  process  whose  clusters  and  points  within  a 
cluster  are  sparse  (this  is  analogous  to  the  Poisson  approximation  for  rare 
events  as  in  Theorem  3.7). 


32 


3.  CONVERGENCE  IN  DISTRIBUTION  OF  POINT  PROCESSES 

As  in  many  areas  of  probability,  the  notion  of  convergence  in 
distribution  plays  an  important  role  in  the  theory  and  applications  of  point 
processes.  The  focus  of  this  section  is  on  the  convergence  in  distribution 
of  sums  of  independent  point  processes  to  Poisson  and  infinitely  divisible 
processes  and  on  related  rates  of  convergence  and  Poisson  approximations. 

3.1  Basics  of  Convergence  in  Distribution 

We  begin  with  a  short  review.  Suppose  X.X^.Xg. •••  are  random  variables 
that  take  values  in  E  (think  of  these  as  general  random  elements  not  as 
locations  of  points).  The  sequence  X^  converges  in  distribution  to  X. 
written  Xn  ^  X,  if  E f ( X^ )  -»Ef(X)  for  every  bounded  continuous  f:  E  -»  R  (i.e. 
the  probability  distribution  of  X^  converges  weakly  to  that  of  X).  A  simple 
characterization  is  that  X^  ^  X  if  and  only  if  P(Xn£A)  -*  P(X€A)  for  each  A€£ 
with  P{X€  cJA)  =  0  (here  dk  means  the  boundary  of  A). 

The  importance  of  convergence  in  distribution  is  manifest  by  the 
following  basic  results  (see  Billingsley  (1968)  for  further  properties  of 


convergence  in  distribution). 

Continuous  Mapping  Principle.  If  X^  ^  X,  then  f(X^)  f(X)  for  every 


continuous  f :  E  -*  E'  . 

Convergence  of  Expectations.  Suppose  E  =  R+  and  ^  X.  Then  EX^  -»  EX  <  00 

if  and  only  if  the  X  are  uniformly  integrable:  Sup  EfX^ 1 ( | X^ |  >  x)]  -*  0  as 

n  n 


x  -*  °°. 
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We  now  return  to  point  processes.  For  a  point  process  N  on  E,  we  define 

B^  =  {  B  €  B-  N(5B)  =  0  a.s.}  and  define  as  the  sefof  all  intervals  in 

B^.  Let  N.Nj.Ng....  be  point  processes  on  E.  Here  are  some 

d 

characterizations  of  the  convergence  N  -*  N,  which  is  defined  as  above  (see 

n 

Theorem  4.2  in  Kallenberg  (1983)). 


Theorem  3.1.  The  following  statements  are  equivalent. 

(i)  N^N. 

(H)  (Nn(I,) . W)  *  . Ndk)).  Ir...lk  in  IN. 

(iii)  /£  f(x)Nn(dx)  i  f£  f(x)M(dx),  f€CK. 

(iv)  ln  (f)  -  ^(f).  fCC^. 

n 

It  is  easy  to  see  that  when  statement  (ii)  is  true,  then  it  also  holds 


for  any  I  . I.  in  E  with  N(dl  .)  =  0  a.s.  Similarly,  statement  (iii) 

extends  to  bounded  f:  E  -*  R+  with  (x  =  f(x)  >  0}  6  B  and  N(Df)  =  0  a.s. .  where 

Dj.  is  the  set  of  discountinui ty  points  of  f.  Condition  (iv)  is  commonly  used 

to  establish  (i).  while  (ii)  and  (iii)  are  used  as  properties  or  consequences 

of  N  ^  N. 
n 

An  elementary  type  of  convergence  is  if  is  a  sequence  of  point 
processes  defined  by  parameters  (e.g.  a  vector  of  numbers  and  measures), 
and  converges  if  an  does.  For  example,  if  is  a  Cox  process  directed  by 
A  and  A  ^  A.  then  N  ^  N  where  N  is  a  Cox  process  directed  by  A.  Similar 
statements  apply  to  Poisson,  negative  binomial  and  sample  processes.  Also, 
when  E  =  R  .  then  from  Remark  1.2  it  follows  that  N  ^  N  if  and  only  if  their 
point  locations  or  interpoint  locations  converge  accordingly 
((T^j . T^k)  (^i . Tk)  for  each  k) .  In  particular,  renewal  processes 
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N  ”  N  if  and  only  if  their  waiting  time  distributions  converge  accordingly 

n 

(Fn(x)  -»  F(x)  for  each  F-continuity  point  x). 

The  following  is  a  useful  characterization  of  convergence  when  the  limit 
process  is  simple. 

Theorem  3.2.  Suppose  N  is  simple  and 


(3.1) 


1 im  limsup  P(N  (B)  >  m)  =0.  B €B. 

m-*»  n-*“  1 


Then  N  -»  N  if  and  only  if 
n 

lim  P{N  (B)  =  0}  =  P{N(B)  =  0}.  B€B^. 

n-*» 

Proof .  The  necessity  follows  from  Theorem  3.1.  and  the  sufficiency  follows 
from  the  uniqueness  property  in  Remark  1.2(b)  (since  (3.1)  implies  that  is 
relatively  compact;  see  §4  in  Kallenberg  (1983)). 

Remark  3.3.  A  sufficient  condition  for  (3.1)  is  lim  sup  EN^fl)  <  EN(I)  <  «®, 

n-*o 

I  €  I  (see  54  in  Kallenberg  (1983)). 


3.2.  Convergence  to  Poisson  Processes 

We  now  show  that  Poisson  processes  arise  as  limits  of  sums  of  sparce 

point  processes  and  as  limits  of  rare-event  processes. 

Suppose,  for  each  n.  that  N  . ,N  ,,...  is  a  finite  or  infinite  sequence 

nl  n2 

of  independent  point  processes  on  E  such  that  1  N  .(B)  <  00 .  BtB,  a.s.  and 

j  nJ 

that  they  are  uniformly  null: 


lim  sup  P(N  (I)  >  1)  =  0.  I€I. 
n-*°  j  nj 

We  call  (N^j }  a  null  array  of  point  processes. 


s' 

t' 


■ .« 


f  »i«. 


The  following  result  is  due  to  Crigelionis  (1963)  (he  proved  it  for  E=R 
and  Jagers  (1972)  proved  it  for  general  spaces;  see  pp  175-6  in  Kallenberg 
(1983)  for  further  credits). 

Theorem  3.4.  Suppose  (N^)  is  a  null  array  and  N  is  a  Poisson  process  with 

mean  A.  Then  2.N  .  B  N  if  and  only  if 
J  nj 

(3.2)  lim  2  P{Nn.(B)  >  1}  =  A(B) .  BeB^  and 

n-n®  j  nj 


(3.3) 


lim  2  P(N  (B)  >  2}  =  0  B€B. 
n-*"  j  nj 


Proof .  This  is  a  special  case  of  Theorem  3.S.  To  illustrate  the  analysis 
dealing  with  convergence,  we  shall  apply  Theorem  3.2  to  prove  that  (3.2)  and 

(3.3)  imply  N  B  N  when  N  is  simple.  Fix  BCB  and  let  p  .  =  P(N  .(B)  >  1}  and 

N  =  2  N  ..  We  can  write. 

°  j  nJ 

(3.4)  P(Nn(B)  =  0}  =  17  P(Nn.(B)  =  0)  =  exp  2  log  P{N.(B)  =  0} 

j  nJ  j  J 


=  exp(  -  2  p  .  -  2  2  p  ,/k) . 

j  nj  j  k=l  nj 

Now  for  n  large  enough  so  that  sup  p  <  1/2.  we  have 
00  00 

2  2  pk  ,/k  <  2  p^ .  2  pk .  <  2  sup  p  .  2  p  .  -*  0. 
j  k=l  "J  j  "•>  k=l  ">  “  j  "J  j  nj 

Using  this  and  the  assumption  2  p  .  -»  A(B)  in  (3.4)  yields 

j  nJ 


P(Nn(B)  =  0}  -*  e  A(B)  =  P{N(B)  =  0).  BC^. 


Next,  observe  that 
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P{Nn(B)  >  k}  <  pju  {^nj(B)  >  2}  U{at  least  k  different  N^(B)  =  1 }  j 


<  I  PIN  .(B)  >  2}  +  2 

'  J  nJ  "  J, 


2  P  .  .  .  .  P  . 

"'I  ^ 


<  2  P{Nnj(B)  >  2}  +  (2  pnj)k  -  A(B)k. 

m 

Since  A(B)  <  <*>.  we  can  choose  a  finite  partition  B  =  U  B.  with  A(B.)  <  1 

i  =  l 

for  each  i.  Then  using  P{N^(B)  >  k)  <  P{ ( B ^ )  >  k)  and  the  preceding 

1 imi t .  we  have 


1 im  lim  sup  P{N  (B)  >  k)  <  lim  2  A(B. )  =  0. 

k-»°  n-*°  k->“  i  =  l  1 

Thus  Theorem  3.2  yields  N  ^  N. 

n 

The  preceding  result  is  frequently  used  to  justify  a  Poisson  model  for 

sums  of  sparce  processes.  Care  should  be  taken  in  invoking  this  result. 

however,  since  the  sum  2  may  converge  to  limits  that  are  not  Poisson:  see 

Theorem  3.8.  The  closeness  of  2  .N  .  to  being  Poisson  can  sometimes  be 

J  nj 

assessed  by  results  as  in  %  3.4.  A  corollary  of  the  preceding  for  sums  of 
renewal  processes  is  as  follows. 

Corollary  3.5.  Suppose  N  are  independent  renewal  processes  with 

interpoint  distributions  F  j.F^ .  respectively,  such  that 


(3.5) 


lim  sup  F  .(t)  =0,  t  >  0. 

^  ■  nJ 

n-*°  j 


Let  N  be  a  Poisson  process  on  R  with  mean  A.  Then  2.  N  ,  N  if  and  only  if 

+  J  nj 


2  F  . (  t)  -»  A(0,  i] ,  for  each  t  with  A((t})  =  0. 
j  nJ 

Proof .  By  Theorem  .3.4,  it  suffices  to  show  that  (3.5)  is  equivalent  to  (3.2) 
and  (.3.3).  But  this  follows  immediately  from  the  relations 
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2  P{N  .(0,  t]  >  1}  =  2  F  .(c) 
j  nJ  j  nj 


2  P{N  ,(0.t]  >  2}  =  2  F  *F  .( t )  <  2  F  .(t)  <  sup  F  .(t)  2  F  .  ( t ) . 

j  v  njv  J  “  j  nj  njv  -  .  njv  ~  ^  njv  njv 


Example  3.6.  Suppose  Nj .Ng. . . .  are  independent  renewal  processes  wi 


th 


interpoint  distribution  F.  Consider  the  sum  2.  ,  N..  As  n-*°,  this  sum  tends 

J=1  J 


to  infinity.  However,  we  would  like  to  normalize  this  sum,  as  in  a  central 
limit  phenomenon,  so  that  it  converges  to  some  point  process.  A  natural  way 


to  do  this  is  by  rescaling  the  time  axis.  Accordingly,  consider  the  process 


N  (0 ,  tl  =  2  N  .(0,  t/n] 

n  j  =  l  J 


which  is  the  sum  with  the  time  axis  expanded  such  that  1/n  is  the  new  unit  of 
time.  Suppose  the  derivative  F‘ (0)  =  A  >  0.  Then  clearly 


Nnj(0, t]  =  Nj(0. t/n]  is  a  renewal  process  with  interpoint  distribution 


F(t/n).  and  the  conditions  of  Corollary  3.5  are  satisfied  with  2 

j  =  l 


P{ N^. (0 ,  t/n]  >  1}  =  n  F(t/n)  -»  tA  as  n-*°.  Thus  N^  -»  N.  a  stationary  Poisson 


process  with  rate  A. 

The  Poisson  process  is  sometimes  referred  to  as  a  point  process  of  rate 
events  because  of  the  classical  result  that  the  number  of  successes  in  a 
sequence  of  Bernoulli  trials  is  asymptotically  Poisson  as  the  probability  of 
success  tends  to  0.  We  shall  now  present  this  rareness  property  for  point 
processes  other  than  Bernoulli  processes.  We  discuss  rareness  in  terms  of 
thinning  (recall  §2.3). 


Let  N  be  a  point  process  on  E  =  K  .  Suppose  is  a  p^-thinning  of  N, 


where  p^  -*  0  (p^  is  the  probability  of  retaining  a  point).  As  p^  -»  0.  the 


J 

A 

4 

4 
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points  of  N  are  rarer  and  N'  -»  0.  We  would  like  to  normalize  N‘  to  study 
n  n  n 


its  asymptotic  behavior.  Accordingly,  consider  the  prdcess  N  (B)  =  N‘(p  *B). 

n  n  n 


which  is  the  thinned  process  with  the  space  compressed  such  that  p  *  is 


the  new  unit  of  volume.  In  addition,  suppose  that  N  satisfies  the  weak  law 


of  large  numbers 


N(Bk)/|Bkl  X  as  k  ->  « 

for  any  sequence  B^  in  B  with  the  area  |  B^  |  -»  where  A  is  a  positive 


cons  tant . 


Theorem  3.7.  Under  the  preceding  assumptions.  N^  ^  N*.  where  N*  is  a 


stationary  Poisson  process  with  rate  X. 


Proof .  One  approach  is  to  verify  (f)  L  ^(f)  by  direct  computations.  An 

n  N 


alternative,  informative  approach  is  to  observe  that  this  assertion  is  a 


"randomized  version"  of  Theorem  3.4.  Namely,  suppose  N  =  I  6  .  and  let 

j-1  X. 


Z  ,.Z  „,...  be  independent  Bernoulli  random  variables  wi th  p  =  P(Z  =11. 
nl  n2  n  '  ni  ' 


Then  we  can  write 


_1  v  -!  » 

N  (B)  =  N ' (p  B)  =  1  Z  .  1 (X  €p  lB)  =  I  N  .(B). 

nv  vtn  j=1  nj  v  n  Kn  '  j  njv  1 


where  N  .  =  Z  .  6  v  .  Now.  note  that,  given  N.  the  {N  .}  satisfy  tl 
n.l  nj  p  X  6  nj' 


assumptions  of  Theorem  3.4  (in  terms  of  probabilities  conditioned  on  N)  with 


^  P{Nn.(B)  >  1  |  N)  =  p^p^B)  ^  A  |B  | 


Consequent ly , 


h|exp  -  /£  f(x)Nn(dx)  |  N  |  ^  exp  -  1  -  e  ‘^JAdx  =  l^,M(f). 

Then  taking  expectations  yields  (f)  -*  L^*(f). 


-  •  •  •  ' 


Renyi  (1967)  proved  Theorem  3.7  for  a  renewal  process  N.  A  special  case 

is  where  N  is  non-random  with  one  point  at  each  integer-  1 . 2. .. .  Then  N  is  a 

n 

Bernoulli  point  process  with  probability  p^  of  a  point  at  each  of  the 

““1  ^ 

locations  p  .  2p  .  3p  .  where  p  N(p  t)  -»  t.  and  N  -*  N  is  the  classical 

Binomial-to-Poisson  convergence.  This  result  (which  is  a  functional  limit 

theorem)  can  be  viewed  as  the  Poisson  analogue  of  Donsker's  functional 

central  limit  theorem  for  sums  with  the  Weiner  process  as  a  limit.  The 

normalization  N‘(p  *B)  is  rather  natural:  a  normalization  of  the  form 
n  n 

a  N  (b  B)  is  analogous  to  (I.  .  Z.  -  a  )/b  (note  that  b  rescales  the  space 

nn  n  k=l  k  n  n  n  1 

in  the  former  and  rescales  the  quantity  in  the  latter).  Kal lenberg  (1983) 
extended  Theorem  3.7  to  general  E  and  initial  processes  N  that  vary  with  n 
such  that  the  limits  are  nonstationary  Poisson  or  Cox  processes.  For  further 
results  on  thinnings  of  point- processes,  see  Serfozo  (1980,  198-la.  b)  and  the 
references  therein. 

3.3  Convergence  to  Infinitely  Divisible  Point  Processes 

We  saw  that  the  sum  1  N^.  of  a  null  array  of  point  processes  may 

converge  in  distribution  to  a  Poisson  process.  Other  limits,  however,  are 

possible.  We  now  show  that  such  sums  may  converge  to  infinitely  divisible 

point  processes  and  that  these  are  the  only  possible  limits. 

A  point  process  N  on  E  is  infinitely  divisible  if  for  each  n  there  are 

independent  identically  distributed  point  processes  N. . N  such  that 

1  n 

N  =  Nj  +  .-.+N^.  We  sliall  also  be  interested  in  point  processes  that  are 
infinitely  divisible  with  independent  increments.  The  following  are  useful 
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characterizations  for  such  processes  (these  are  from  Theorems  7.1.  7.2  and 


6.1.  respectively,  in  Kallenberg  (1983)) 


(a)  A  process  N  has  independent  increments  if  and  only  if  it  has  a 


representation  of  the  form  N  =  N‘  +  2  Z  .<5  .  where  N'  is  infintely 

j=l  J  *J 


divisible  with  independent  increments,  x^.  are  non-random  points  in  E,  k  <  00 


is  non-random,  and  are  positive  integer-valued  random  variables 


independent  of  N ' . 


(b)  A  point  process  N  is  infinitely  divisible  with  independent  increments  if 


and  only  if 


(3.6) 


1^(0  =  exp{-  2  /E(l  -  e"ml(x)hm(dx)} 

'  m  11  ' 


where  is  a  measure  on  E.  For  example,  when  -r^fdx)  =  F({m))A(dx),  then  N 


is  a  compound  Poisson  process-whose  Poisson  points  have  mean  A  and  mass 


distribution  F. 


(c)  A  point  process  N  is  infinitely  divisible  if  and  only  if 
(3.7)  LN(f)  =  exp  {-  \H  1  -  e"/f(x)M(dx)  „(dM)J 


LN(f)  =  exp  {-  [l  - 


where  rj  is  a  measure  on  the  set  Aq  of  non-zero  counting  measures  4  on  E  such 


that  /  ( 1  -  e  ^  ')nr(dp)  <  °°.  B€B.  In  other  words,  N  is  infinitely  divisible 


if  and  only  if  it  is  a  Poisson  cluster  process  (recall  §  2.5). 


The  following  are  fundamental  results  on  the  convergence  of  sums;  see 


Theorems  6.1  and  7.2  of  Kallenberg  (1983).  Suppose  that  (N  }  is  a  null 


array  of  point  processes  on  E.  Let  N’  be  an  infinitely  divisible  point 


process  on  E  with  independent  increments  as  in  (b)  and  let  N  be  an 


infinitely  divisible  point  process  on  E  as  in  (c). 


Theorem  3.8.  If  2.  N  .  to  some  N.  then  N  is  infinitely  divisible.  A 
J  nJ 

necessary  and  sufficient  condition  for  2  .N  .  ^  N‘  is  that 

J  nj 

lim  2  P{N  .(I)  =  m)  =  i  (I).  I€T 
n-*°  j 

A  necessary  and  sufficient  condition  for  2 .N  .  -*  N  is  that 

J  n.) 


s  ['  -  ln  <f>]  =  '.J'  - 

i  rt  \  n 


lim  2  1  -  Ln  (f) 

n-*"  ,j  L  nj 

This  condition  is  equivalent  to 


-/ f(x)fi(dx) 


n(  dp)  • 


lim  2  P{N  (Ij)  =  "j . ^  (  rr)  =  mr>  =  fi(Ij)  =  mj . M(  Ir )  =  m  } 

n-*°  j 

for  I . . I  in  I,, 

1  r  N. 

The  preceding  results  show  that  infinitely  divisible  point  processes 
arise  naturally  as  Poisson  cluster  processes  and  as  sums  of  sparce  point 
processes.  They  also  arise  as  limits  of  compound  point  processes  with 
uniformly  small  masses,  similar  to  the  Poisson  rare-event  property  in  Theorem 
3.7;  see  58  of  Kal lenberg  (1983)  and  Serfozo  (1984).  The  convergence  of 
point  processes  is  an  important  tool  for  analyzing  high-level  exceedances  or 
rare  events  of  a  stochastic  process.  Here  is  an  elementary  example. 

Example  3.9.  High-Level  Exceedances  of  a  Random  Walk.  Let  ,Y^. . .  be  a 

simple  random  walk  on  (0,1 . }  whose  probabilities  of  moving  forward  or 

backward  one  unit  are  respectively  p  and  q  =  l-p,  and  P{Y^+j  =  1  |  Y^  =  0}  =  1  . 
Consider  the  point  process 


V  JVM^WJWA/WA  A'A'.V^mv.vwrr^-vif* 
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This  records  the  number  of  steps  at  which  the  walk  exceeds  the  level  n  (or 

the  amount  of  time  the  walk  spends  in  [n,®)).  We  are  interested  in  the 

behavior  of  N'  as  the  level  n  -*  °°.  Accordingly,  we  consider  the  normalized 
n 

process  Nn(t)  =  Nn(ant),  where  a^  =  (q/p)n/(q/p- 1 ) .  As  an  application  of 
Theorem  3.8,  it  follows  that  ->  N.  where  N  is  a  compound  Poisson  process 
with  stationary  Poisson  points  at  rate  (l-p/q)/2  and  mass  distribution 

F({m})  =  1  gkM(m)(p/q)m  ^l-p/q) 

k=l 


where 


g(2k-l)  =  (-1) 


k-1 


1/2 

k 


(4pq)  /(2p) 


k  >  1 


The  limit  N  is  compound  Poisson  rather  than  just  Poisson  because  there  is  a 
clumping  of  points  in  :  when  the  walk  exceeds  n  it  typically  stays  there 
for  several  steps  in  succession  before  wandering  below  n.  This  result 
appears  in  Serfozo  (1980).  See  this  paper.  Leadbetter  et.  al  (1983),  Using 
el  al .  (1987)  and  their  references  for  similar  results  on  high-level 
exceedances,  or  level-crossings  for  stationary  and  other  processes. 

3.4  Poisson  Approximations 

Regarding  the  preceding  convergence  theorems,  a  typical  concern  is  the 
rate  of  the  convergence  or  the  nearness  of  the  distribution  of  2jN^^(A)  to 
that  of  its  limit.  There  are  several  metrics  or  distance  measures  available 


for  addressing  such  issues.  We  shall  discuss  the  total-variation  metric  and 
its  use  for  assessing  the  quality  of  Poisson  approximations.  The  following 
results  are  based  on  ideas  in  Serf  ling  (1975),  Serfozo  (1986)  and  their 
references . 

We  begin  with  an  introduction  to  total-variation  distances.  Suppose  X 
and  Y  are  real-valued  random  variables  not  necessarily  on  the  same 
probability  space.  The  total  variation  distance  between  X  and  Y  (or  between 
their  distributions)  is 

d(X.Y)  =  sup  |P(X€B)  -  P(Y€B}|. 

B 

where  the  supremum  is  over  all  Bore l  sets  B  in  R.  When  X  and  Y  are 
integer- valued ,  this  reduces  to 

d(X.Y)  =  |  2  | P (X=m)  -  P{ Y=m) | . 
m 

Here  are  some  basic  properties  of  this  distance  measure. 

(a)  Coupling  Inequality:  d(X,Y)  <  P(X'ZY’),  for  any  random  variables  X'.Y' 
on  a  single  probability  space  such  that  X'  =  X  and  Y'  =  Y.  One  can  derive 
bounds  for  d(X.Y)  by  constructing  X' ,  Y'  for  which  P(XVY')  is  small  and 
calculable.  There  are  X'.Y'  for  which  equality  obtains. 

(b)  Triangle  Inequality:  d(X,Y)  <  d(X.Z)  +  d(Z.Y). 

(c)  d(X.Y)  <  E[sup | P(X ' €B |U)  -  P(Y'€B|V}|],  for  any  random  variables 

B 

X'.Y'.U.V  on  a  single  probability  space  such  that  X'  =  X  and  Y'  =  Y.  We 
write  this  as  d(X.Y)  <  E[d(X'|U.  Y'|V)]. 


M 


(d)  If  X . X  are  independent,  and  Y 

In  i 


Y  are  independent,  then 


n 

d(  2  X.. 

j=l  J 


n 

2  Y.) 

j=i  J 


n 

<  s 

j=l 


d(X..Y  .). 
J  J 


(e)  If  X  and  Y  are  Poisson  with  respective  means  u  and  [).  then  d(X.Y)  < 

\a-(i  | . 

(f)  If  X  is  a  Bernoulli  random  variable  with  p  =  P{X=1).  and  Y  is  Poisson 
with  mean  p.  then  d(X,Y)  <  p^. 

(g)  Measurable  Mapping  Principle:  If  d(X^.X)  -♦  0.  then  X^  ^  X  and. 
moreover.  f(X^)  f(x)  for  any  (measurable)  f:  R-iR  (cf.  the  continuous 
mapping  principle  in  %3.1).  This  observation  is  useful  for  establishing 
limit  theorems. 

The  next  result,  as  we  shall  show,  is  useful  for  assessing  Poisson 
approximations.  Similar  results  hold  for  sums  of  dependent  variables  and  for 
compound  Poisson  approximations. 

Theorem  3.10.  Suppose  X^ . X^  are  independent  non-negative  integer- valued 

random  variables  and  Y  is  a  Poisson  random  variable  with  mean  a.  Then 


n  n  „  n 

d(  I  X..Y)  <  2  [P(X.  >  2}  +  P(X.  >  lp]  +  |«  -  2  P{X.  >  1}|. 

j=l  J  j=l  J  J  j=l  J 


Proof ■  Let  Yj . Y^  be  independent  Poisson  random  variables  with  respective 

means  P { X  ^  > 1 } . P { X^  > I } -  Then  by  properties  (b).(d),(e).  we  have 
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d(  2  X..  Y)  <  d(  2  X  2  I{X.  >  i))  +  d(  2  1  (X .  >  1).  2  Y.) 

j  =  l  J  j=l  J  j=l  J  j  =  l  .  J  j=l  J 


+  d(  2  Y  Y) 
j  =  l  J 


<  2  d(X  1 ( X  >  1))  ♦  2  d( 1 (X  >  1).  Y  ) 

j=l  J  J  j=l  J  J 


♦  l«  ~  2  P{X  >  1  >  |  . 


Using  d(X . .  1(X.  >  1))  =  P{X.  >  2}  and  d(l(X.  >  1).  Y.)  <  P{X.  >  1 )  from  (f) 

J  J  J  J  J  J 

in  the  last  line  yields  the  assertion. 

We  now  apply  the  preceding  ideas  to  point  processes.  Here  is  a 
companion  to  the  Poisson  convergence  in  Theorem  3.4. 

Corollary  3.11.  Suppose  {N^.}  is  a  null  array  of  point  processes  on  E  and  N 
is  a  Poisson  process  on  E  with  mean  A.  Then ,  for  AC£, 


d(2  N  (A).  N(A) )  <  2  P{N  (A)  >  2}  ♦  2  P{N  (A)  >  1}‘ 

j  j  j 


♦  |A(A)  -  2  P{N  (A)  >  1}| 
j  J 


This  is  an  immediate  consequence  of  Theorem  3.10  (which  also  holds  for 
n=“) .  Under  the  assumptions  of  Theorem  3.10,  the  right  side  of  the  preceding 
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The  next  result  is  a  companion  to  the  rare-event  property  of  Theorem 

3.7. 

Corollary  3.12.  Suppose  is  the  rescaled  p^-thinning  of  N  as  in  Theorem 
3.7  and  N  is  a  stationary  Poisson  process  with  rate  X.  Then,  for  B£B. 

(3.8)  d(Nn(B).  N*(B) )  <  p2n  E[N(pnB)]  ♦  E[  |  \|b|  -  pnN(pnB)|]. 

Proof .  Using  property  (c).  Theorem  3.10  and  the  notation  in  the  proof  of 
Theorem  3.7,  we  have 


d(Nn(B).  N  (B))  <  E[d(Nn(B)|N.  N  (B))]  <  E 


2  P{Z  l(p  X  €8)  =  1  |N}“ 
nJ  "  n 


+  E 


|  x|b|  -  ^  P<  ZnJl(pnXnCB)  =  1} 


=  E 


r  u  2 

2  p  1(P  X  €B) 
.  .  n  n  n  ’ 
J  =  1 


+  E 


I  A|B |  -  2  pnl(pnXn€B) 

j  =  I 


where  the  last  two  expectations  are  equal  to  those  in  the  assertion. 

Note  that  the  right  side  of  (3.8)  tends  to  zero  when  N  satisfies  the 

weak  law  of  large  numbers  as  in  Theorem  3.7  and  lim  sup  p  E[N(p  B)]  <  00 

n-*»  '  ' 

(consequently.  N  (B)  -♦  N  (B),  which  we  also  know  from  Theorem  3.7). 
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4.  RENEWAL  THEORY 

The  theory  of  renewal  processes  was  developed  in  the  '40s,  '50s  and  '60s 
by  Blackwell,  Doob.  Feller.  Smith  and  others.  The  major  topics  of  this 
subject  are:  (a)  The  key  renewal  theorem,  which  describes  the  limiting 
behavior  of  the  solution  to  a  renewal  equation.  (b)  Applications  of  the  key 
renewal  theorem  to  obtain  limits  of  means  and  distributions  of  functionals  of 
renewal  and  regenerative  processes.  (c)  Limit  laws  of  renewal,  compound 
renewal  or  regenerative  processes  that  are  consequences  of  analogous  limit 
laws  for  sums  of  independent  random  variables.  (d)  Processes  with  a 
renewal-like  structure  (e.g.  alternating,  transient,  or  branching  renewal 
processes).  (e)  Statistical  properties  of  renewal  and  regenerative 
processes.  (f)  Applications  in  systems  that  regenerate  over  time  (e.g. 
systems  involving  queueing,  reliability,  inventory  control  or  cash  flows). 

Since  renewal  theory  is  a  common  topic  in  introductory  texts  on 
stochastic  processes,  our  coverage  will  be  brief  and  confined  to  only  the 
first  three  topics,  with  a  novel  treatment  of  the  last  two.  Basic  references 
are  Feller  (1971),  Cinlar  (1975)  and  Gut  and  Prabhu  (1987). 

4.1  Distributions  of  Renewal  Processes 

Suppose  that  N  is  a  renewal  process  on  with  renewal  times 
0  <  Tj  <  T^  <...  and  independent  waiting  times  between  renewals  Wj.W^,... 
that  have  the  d i s t r i bu t i on  F.  For  simplicity,  we  write  =  N[0.t].  Some 
useful  relations  between  the  numbers  of  renewals  and  the  renewal  times  are 

CO  00 

N  =  £  1(T  <  i)  =  X  n  1  ( T  <  t  <  r  ,)  =  sup{n :  T  <  t>. 

t  ,  v  n  -  '  .  '  n  n+ 1 '  n  -  ' 

n=l  n=l 

(N(  >  n)  =  (Tn  <  t).  and  I'N  <  t  <  I'N  +[. 

These  properties,  which  follow  by  inspection,  are  true  for  any  point  process 
N  on  R+  with  N(R+)  =  <».  An  immediate  consequence  is 


,1a'. 


li  -k|  .li'JVjHVl  B<|  .U  m'k  .*1  .U  tW1.**  4H  »*|  aJfc  t<|J*lV>'t**.l 


P{N  =  n}  =  P{Nt  >  n}  -  P{Nt  >  n  +  1} 

=  P{Tn  <  t)  -  P{Tn+1  <  t)  =  Fn*(t)  -  F(n+1)*(t). 
where  F*1*  is  the  n-th  fold  convolution  of  F.  In  addition,  all  moments  of  N 


are  f ini te  and 


EN  =  2  E[1(T  <  t)]  =  2  F"  (t). 

n= 1  n=l 


The  renewal  function 


U(t)  =  2  Fn  (t)  =  1  +  EN  . 

n=0  C 

plays  an  important  role  in  characterizing  N  and  it  is  the  focus  of  the  key 
renewal  theorem.  We  first  note  that  U  and  the  distribution  of  N  uniquely 

determine  each  other.  To  see  this,  take  the  Laplace  transform  of  the 

~  ~  -1  ~  ~ 

preceding  equation  to  get  U(s)  =  (1  -  F(s))  .  where  U,  F  are  Laplace 

transforms  of  U.F.  Then  clearly  U  and  F  uniquely  determine  each  other  and 
hence  so  do  U  and  F.  But  we  know  by  Remark  1.11  that  F  and  the  distribution 
of  N  uniquely  determine  each  other.  Thus  the  assertion  follows.  As  an 
example,  N  is  a  stationary  Poisson  process  with  rate  p  1  if  and  only  if 
U(t)  =  1  +  t/p.  Unfortunately,  nice  expressions  for  renewal  functions  are 
the  exception  rather  than  the  rule. 

The  following  limit  laws  for  describe  its  ascension  to  00  as  t~*°.  We 

let  p  <  00  denote  the  mean  of  F,  and  we  interpret  l/00  as  0.  Recall  that  a 

distribution  F  is  ari thmet ic  if  its  jumps  are  concentrated  on  points  of  the 

form  d.2d.3d,...  and  the  largest  d  with  this  property  is  the  span. 

Strong  Law  of  Large  Numbers:  N^/t  -*  1/p  a.s.  (Corollary  4.12). 

Central  Limit  Theorem:  If  the  variance  o2  of  F  is  finite,  then 

(N  ^  -  t/p  )/(ct  t^^p  ^^)  i  Z.  where  L  is  a  standard  normal  random  variable. 

r  r  2 

Convergence  of  Moments'-  E(N^/t)  -»  (1/p)  for  r  >  1,  and.  when  a  exists. 


V  W  V  V  V  V  ^  r.r,  r  r  t  *■,  v  f|  .• 


-  V  .  V  V  V  *  -  V 


EN^  =  t//i  +  (a  -  +  o(  1  )  rind  VarN^  =  ta“/ji"  +  o(t), 

where  t-*°  and,  in  case  F  is  arithmetic,  then  t  is  a  multiple  of  the  span 
(these  statements  follow  from  Example  4.8). 

Renewal  processes  are  intimately  related  to  processes  that  are 
regenerative  or  have  regenerative  increments  as  follows.  Suppose  X  =  (X^; 
t€R+ }  is  a  stochastic  process  with  state  space  E  and  sample  paths  in  the  set 
D(R+.E)  of  all  functions  from  R+  to  E  that  are  right-continuous  and  liave 
left-hand  limits.  The  X  is  a  regenerative  process  with  regeneration  times 

<o 

T,  ,T„.  .  .  .  if  N  -  1  ,  6.r.  is  a  renewal  process  and,  for  each  t. . t.  ,  w  in 

1  2  n=l  f  Ik 


R  and  A . . A.  in  E. 

+  1  k 


(4.1)  P(W  ,  <  w.  X„  C  A .  X„  €  A.  |  W, . W  ;  X  .  s  <  T  } 

v  ’  '  n+1  '  T  +  t,  1  T  +t.  k  1  1  ns  -  n' 

n  1  n  k 


=  '■(»,  <-  »•  X.  6  A, . X  t  Ak|. 

1  •  k 

The  nth  cycle  of  X  consists  of  the  information 


n  =  0.1. 


f  =  (W  .  {X-  ;  0  <  u  <  W  } ) .  n  =  1,2, . . . 

5n  n'T+u  n  " 

n- 1 

which  is  the  cycle  time  W  =  T  -  T  .  and  the  trajectory  of  X  in  fT  , ,T  ]. 

— 1 -  nnn-1  L  n-1  nJ 

Condition  (4.1)  is  equivalent  to  being  independent  and  identically 

distributed  (which  also  implies  that  N  is  a  renewal  process).  This 
definition  is  equivalent  to  that  in  Cinlar  (1975);  we  avoid  his  assumption 
that.T^  is  a  stopping  time  of  X  by  including  ^  in  (4.1).  Positive 
recurrent  Markov  or  semi-Markov  processes  are  examples  of  regenerative 
processes . 

Now  suppose  X  =  {X^;tCR+}  has  state  space  R  and  sample  paths  in  D(R+,R). 

U> 

The  X  has  regenerative  increments  over  T,.T., ....  if  N  =  1  .  f>...  is  a  renewal 

— -  1  2  n=l  1 

n 


process  and,  for  each  w,  x, 


, x.  and  0  <  s .  <  t  .<...<  s.  <t,. 
k  1  1  k  k 


(4.2)  P{W  ,  <  w.  X_  -  X_.  <  x, 

v  '  'n+1  -  T  + 1  1  +s ,  -  1 

n  1  n  1 


,X.r  -  X...  A  <  x. 

I  +  t.  1  +s.  k 
n  k  n  k 


W . W  ;  X  .  s  <  T  } 

1  ns"  n 


BiniwiwwifsnJUJiiHiiWitfi wvryisflumuntfri:' mu.  mu., 
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=  P{W,  <  w.  X  -X  <  X . X  -  X  <  X,  }.  n  =  0.1 _ 

'  1  -  t.  s ,  -  1  t,  s,  -  k' 

11  k  k 

This  condition  has  an  interpretation  similar  to  (4.1)  via  cycle  information. 
Such  processes  are  useful  for  modeling  additive  functionals  of  regenerative 
processes  as  in  §4.3  and  §4.4. 

The  notion  of  regeneration  is  also  manifest  in  point  processes.  A  point 
process  N  on  fi+  is  regenerative  over  T^  <  <  ...  if  (N  ;  t€R+)  has 

regenerative  increments  over  these  times.  The  T^’s  need  not  necessarily  be 
points  of  N.  For  example,  the  times  at  which  a  regenerative  process  enters  a 
certain  set  form  a  regenerative  point  process.  Also,  a  point  process  N  on  R+ 
has  regenerative  interpoint  distances  if  is  a  regenerative  sequence 

over  discrete  times  <  ....  See  Neuts  (1979)  and  Wold  (1948)  for 

related  point  processes  (the  N  is  a  Wold  process  when  W^ .W^, . . .  is 
Markovian).  The  analysis  of  such  point  processes  is  similar  in  part  to  that 
of  renewal  processes. 


4.2  Key  Renewal  Theorem 

We  now  consider  the  renewal  equation 

f(t)  =  g(t)  +  /  f ( t-s)F(ds) ,  t  >  0. 

[O.t] 

where  F  is  the  distribution  as  above  and  f  and  g  are  functions  from  R  to  R 

+  + 

that  are  bounded  on  finite  intervals.  The  F  and  g  are  known  and  f  is 
unknown.  The  f  is  typically  the  mean  or  distribution  of  a  functional  of  N  as 
we  discuss  below.  The  assumption  that  f.g  are  non-negative  is  for 
convenience;  one  can  treat  real-valued  f.g  by  considering  their  positive  and 
negative  parts  separately  (the  positive  and  negative  parts  of  f  are 
f  (x)  =  max(0.f(x)}  and  f  (x)  =  -min{().f(x)}).  The  renewal  equation  f  =  g  + 

F  *  f  lias  the  unique  solution 


V  v  .-.v 


V.V.V.V.  f.  V. 


-*-V-  ■r.  s.  if-  f.V.  c.  «*. k  ■  «* .  W. «•.  ■■  V’.if.  <c.  /nf.  if. wv 
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f(t)  =  /  g(t-s)U(ds)  =  U  *  g(t). 

[O.t] 

This  is  clearly  a  solution  since  g  +  (U  *  g)  *  F  =  U  *  g.  See  Chapter  XI  of 
Feller  (1971)  for  a  proof  of  the  uniqueness  and  for  proofs  of  what  follows. 

A  major  issue  of  renewal  theory  is  the  existence  of  the  limit  of 
U  *  g(t)  as  t-K».  To  describe  this,  we  need  one  more  concept.  A  function 
g:  R+  R+  is  directly  Riemann  integrable  (denoted  g€  D)  if  the  following 
sums  exist 

03 

s(6)  =  62  inf{g(x):  (n-l)6  <  x  <  n6} 
n=l 
00 

S(6)  =6  2  sup{g(x):  (n-l)6  <  x  <  n6) 

n=  1 

and  lim  (S(6)  -  s(6))  =  0.  Consequently,  g  is  bounded  on  finite  intervals 
6-0 

and 

00 

lim  s(6)  =  lim  S(6)  =  /  g(x)dx, 

6-0  6-0  0 

which  is  the  usual  indefinite  Riemann  integral  (the  preceding  conditions  are 
stronger  than  those  needed  for  the  existence  of  the  integral).  Clearly  g  €  D 
if  the  number  of  discontinuities  of  g  is  finite  in  each  finite  interval  and 
either  (i)  g  is  zero  outside  a  finite  interval  or  (ii)  g  is  decreasing  and 

GO 

/  g(x)dx  <  Here  is  another  characterization. 

0 

Lenina  4.1.  (Hinderer  (198G)).  g  €  D  if  and  only  if  S(6)  <  m  for  some  6  and 
g  is  continuous  almost  everywhere  with  respect  to  Lebesque  measure. 


The  following  major  results  describe  the  limiting  behavior  of  U  *  g  and 
U.  (Recall  that  1A°  =  0.) 

Key  Renewal  Theorem  4.2.  If  F  is  not  arithmetic  and  g  C  D,  then 

00 

lim  (J  *  g(  l )  =  ft  ^  /  g(x)dx. 
t-*»  0 


>7 
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If  F  is  arithmetic  with  span  d  and  the  following  sum  is  finite,  then 

00 

lim  U  *  g(x+nd)  =  p  *  2  g(x+kd). 

n-*°  k=l 

Blackwell's  Renewal  Theorem  4,3.  If  F  is  not  arithmetic,  then  U(t+h)  - 

U(  t)  -»  h/p  as  t  h  >0.  If  F  isari  thmetic.  then  this  limit  holds  with  t 

a  multiple  of  the  span. 

These  two  limit  theorems  are  actually  equivalent'-  The  latter  follows 
from  the  former  with  g(t)  =  l(t€(0,u]).  and  the  proof  of  the  reverse 
implication  is  implicit  in  Feller’s  (1971)  proof  of  the  key  renewal  theorem. 
See  £inlar  (1972),  Kesten  (1974)  and  their  references  for  generalizations  of 
the  key  renewal  theorem  to  Markov  renewal  processes. 

4.3  Applications  of  ihe  Key  Renewal  Theorem 

The  key  renewal  theorem  yields  limit  theorems  for  expectations  of 
functionals  of  renewal  and  regenerative  processes.  We  sliall  present  a 
general  approach  for  identifying  new  applications  and  review  some  standard 
examples . 

We  first  note  that  the  standard  applications  of  the  key  renewal  theorem, 
as  in  Feller  (1971),  are  all  limit  statements  of  the  form  lim  E$(t.N,X). 

l-*o 

Here  =  ^(t.N.X)  is  a  functional  of  t,  the  renewal  process  N  and  a  random 
element  X  (e.g.  a  process  or  mark  associated  with  N).  The  f(t)  =  EZ 
satisfies  a  renewal  equation,  and  so  EZ^  =  U  *  g( t )  for  some  g.  This  raises 
the  questions:  What  are  the  possible  functionals  <p  lor  which  EZ^  satisfies  a 
renewal  equation?  Must  Z  be  regenerative?  What  about  X?  The  following 
observation  clears  the  air  in  this  regard. 

Observation  4.4.  Suppose  Z  =  (Z^:  t€R+}  is  a  real-valued  stochastic  process 
on  the  same  probability  space  as  the  renewal  process  N.  Assume  that 


a 

a 

* 
•  ! 

5 


w 
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f(t)  =  EZ^  is  finite  for  each  t.  Then  f  satisfies  the  renewal  equation 
f=g+F*fwith 

(4.3)  g(t)  =  E[Ztl(T1>t)]  +  /[Q  t][E(Zt|T1  =  s)  -  EZt_s]F(ds). 

Hence  EZ^  =  U  *  g(t),  t€R+ .  Furthermore,  when  g+  and  g  are  in  D  and  F  is 
not  ar i thmet ic . then 

lim  EZ  =  v  1  g(x)dx. 
t-*“ 

An  analogous  limit  holds  when  F  is  arithmetic. 

Proof .  This  follows  since 

f(t)  =  E[Z  1(T  >t )]  +  /  E(Z  |  T.=s)F(ds)  -  F  *  f(t)  +  F  *  f(t) 

[0. t]  1 

=  g(0  +  F  *  f(t). 

This  observation  has  the  surprising  implication  that  the  mean  of  any 

real-valued  process  Z  has  the  representation  EZ  =  U  *  g(t).  This  is  of 

t  t 

interest,  of  course,  only  when  Z  depends  on  N;  otherwise,  it  is  vacuous. 
Hence,  if  the  limit  of  EZ^  appears  to  exist,  then  it  is  a  candidate  for  the 
key  renewal  theorem.  The  current  literature  on  renewal  theory  suggests  that 
one  "set  up"  a  renewal  equation  to  obtain  the  representation  EZ^  =  U  *  g(t) 
or  that  one  derive  it  directly,  for  each  application.  This,  however,  is  not 
needed:  The  preceding  observation  says  that  this  representation  is 
automatically  satisfied  for  any  application,  and  that  g  is  given  by  (4.3). 
Remark  4.5.  Two  special  cases  of  (4.3)  are: 

(4.4)  g(t)  =  E[Z t 1 (T j > t ) ] .  when  Z  is  regenerative, 

(4.5)  g(t)  =  E(Z^p  ),  when  Z  has  regenerative  increments. 

The  following  are  examples  of  the  key  renewal  theorem  and  the  preceding 
comments.  For  simplicity,  we  assume  hereafter  that  F  is  not  arithmetic. 
Example  4.6.  Regenerative  Processes.  Suppose  X  =  (X^ :  t€R+)  is  a 
regenerative  process  over  T^ ,T^, . . .  and  h:  E  -»  R+.  Then  from  Observation  4.4 
and  (4.4),  we  liave 


(4.6) 


lim  Eh(Xt)  =  m"1  CQ  E[h(Xs)l(T1>s)]ds. 


provided  the  integral  exists.  It  exists  when  E[Tjb(Tj)]  <  «*>,  where  b(t) 

=  sup  E[h(Xs)  |  Tj  =  t].  The  important  case  of  (4.6)  for  h(Xt)  =  l(Xt€A). 
s<t 

A  €  E,  reads 

lim  P{Xt€A)  =  p_1/q  P{X  6A.  1  >s)ds  =  M~ lE[/Ql 1 (X^CAJds] . 

Other  special  cases  are  in  the  next  example. 

Example  4.7.  Backward  and  Forward  Recurrence  Times.  Two  basic  functionals 

of  the  renewal  process  N  are 

Y  =  t  -  T..  and  Y  ‘  =  Tu  -  t  . 
t  N  t  N  +1 

t  t 

the  backward  and  forward  recurrence  times  at  t  (the  time  since  the  last 

renewal  before  t  and  the  time  to  the  next  one  after  t).  Another  functional 

is  L  =  W„  =  Y'  -  Y  .  the  length  of  the  renewal  interval  containing  t.  To 
t  N  t  t  - a— - - - 

obtain  limits  of  the  means  or  joint  distributions  of  these  processes. 

consider  Z^  =  h(Yt,Y^,I_t)  where  h:  -»  R.  Assume  that  E[Tjb(Tj)]  <  where 

b(t)  =  sup  |h(s, t-s. t) | .  The  Z  is  regenerative,  and  so  by  Example  4.6.  we 
s  <  t  1 


T 

lim  Eh(Y  Y’.L  )  =  P_IE[/  1  h( s ,T  -s ,T { )ds] . 

t-*» 

Hinderer  (1985)  discusses  this  and  related  results.  Here  are  some  special 


cases : 


P(Yt  <  y>  -M  !/J[l-F(s)]ds 
(Y^  and  1.^  have  this  same  limiting  distribution), 

P{Yt  >  y.  Y*  >  y-)  -  1  -  ,i'1  /J+y  [1-E(s)]ds 


P(Y  /I.t  <  x)  -*>  x,  0  <  x  <  1  . 


(the  latter  also  holds  with  Y ^  in  place  of  Y  ). 


E[YkY,?Lm]  -  E(T^+?+m+1)/L(k+/'+l)[k^]  . 

tti  1  (  *  J 

provided  the  last  expectation  is  finite. 

Example  4.8.  Processes  with  Regenerative  Increments.  Suppose  X  =  (X^:  t€R+) 

is  an  increasing  process  with  regenerative  increments  over  Assume 

that  a  =  EX~  exists.  By  the  strong  law  of  large  numbers  f  r  regenerative 

1 

processes  (Corollary  4.12(b)),  we  know  that  t  -»  a/p  a.s.  How  does  t  ^EX^ 

behave  as  t  -*  °°?  Assume  that  F  has  a  variance  o2  and  that  the  distribution 

G(t)  =  a  ^E(X  )  has  a  finite  mean  a.  Then 
t  A  1  j 

(4.7)  lim  [EX  -at/p]  =  (a/p2)[(p2+o2)/2  -  ap] . 
t-*» 

This  follows  by  applying  Observation  4.4  and  (4.5)  to  the  process 


Z  =  X  -  at/p.  which  has  regenerative  increments,  and  observing  that  the 
limit  above  equals 

H~l(l  [E(XsAT  )  -  (a/p)E(sAT1)]ds  =  (a/p2)  [/“[ l-E(sAT1 )]ds  -  /"[ 1-G(s)]ds] . 

which  reduces  to  the  right-hand  side  of  (4.7).  An  immediate  consequence  of 

(4.7)  is  lim  t  *EX  =  a/p.  Special  cases  of  this  are  the  convergence  of 
t-*»  1 

moments  of  N  in  §4.1  and  Example  4.13. 


4.4  Laws  of  Large  Numbers 

Strong  laws  of  large  numbers  for  renewal.  Markov  and  regenerative 
processes  appear  frequently  in  operations  research  studies.  Their  main  use 
is  for  obtaining  easy- tO’understand  performance  measures  of  systems.  They 
are  also  useful  for  establishing  objective  functions  or  constraints  in 
optimization  problems.  The  literature  contains  a  variety  of  laws  of  large 
numbers  for  point  processes  on  R+  and  for  stocliastic  processes  associated 
with  them.  We  shall  present  a  general  limit  law  that  yields  many  of  these 


ostensively  different  laws  as  corollaries.  We  discuss  special  uses  for 

renewal,  Markov  and  regenerative  processes. 

00 

Suppose  that  N  =  2  6^,  is  a  point  process  on  R+  and  Z  =  (Z  :  t€R+}  is 

n  1 

an  increasing  real-valued  process  associated  with  N.  Since  N  is  the 

generalized  inverse  of  (recall  =n) .  one  would  anticipate  that  the 

n 

limiting  behavior  of  N  as  t-*°  would  be  the  inverse  of  that  of  T  as  n-*». 

t  n 

Also,  the  limiting  behavior  of  Z  should  mimic  that  of  the  embedded  process 

2 Lp  .  The  following  results  formalize  these  statements.  Here  we  let  a  and  p 
n 

denote  positive  constants,  one  of  which  may  be  infinite.  Also,  in  the  proofs 

we  write  the  limit  statements  using  the  symbol  ~,  where  g(x)  ~  h(x)  as  x-#° 

means  g(x)/h(x)-*l .  We  also  suppress  the  a.s.  For  example,  n  *T  -»  p  a.s. 

becomes  T  ~  np. 
n 

Theorem  4.9.  If  n  *T  -*pa.s.,  then  t  ->  a/p  a.s.  if  and  only  i  f 

n  t 

-I- 

n  Aj  -*  a  a .  s . 

n 

Proof.  If  Z  ~  at/p,  then  clearly  Z„,  ~  aT  /p  ~  an.  Conversely,  if  Z_  ~ 

-  t  J  I  n  T 

n  n 

an,  then  since  Z  is  increasing  and  T„  <  t  <  T„  , ,  we  have 

N  N  +1 

t  t 


Z  /t  <  Z  /T  -  a(N  +1 )/(pN  )  ~  a/p. 
N  + 1  t 


Zt/t  >  ZT  /Tn  +1  -  aNt/[p(Nt+l)3  -  a/p. 

Nt  1 


Combining  these  statements,  yields  Z{  ~  at/p. 

Corollary  4.10.  t  -»  p  *  a.s.  if  and  only  if  n  -» 


p  a.s. 


Proof .  If  ~  np.  then  by  Theorem  4.9  with  Z£  =  and  recognizing 


n  N.j,  =  1 .  we  get  ~  t/p.  Conversely,  if  Nt  ~  t/p.  then  clearly  = 


n(Tn/NT  )  ~  np. 


Remarks  4.11.  (a)  The  preceding  results  are  also  true  with  a  and  p  random  or 


with  a.s.  replaced  by  convergence  in  probability  or  in  distribution.  (b) 


Theorem  4.9  is  useful  for  analyzing  processes  of  the  form  =  Z*  -  Z^.  where 


and  Z^  are  increasing  (e.g.  when  Z^  has  bounded  variation).  Just  apply 


the  result  to  each  part  separately.  (c)  Many  versions  of  Little's  law  L  =  XW 


for  queues  are  consequences  of  Theorem  4.9.  (d)  Corollary  4.10  yields  a  law 


of  large  numbers  for  any  point  process  N  whose  interpoint  distances  satisfy 


such  a  law  (i.e.  when  n  (W^+...+W^)  converges). 


We  now  specialize  the  results  above  to  renewal  and  to  regenerative 


processes . 


Corollary  4.12.  (a)  If  N  is  a  renewal  process  with  p  =  ETj  <  then  t  lNt  -* 


p  a.s.  (b)  Suppose  Z  has  regenerative  increments  over  Tj.T^,...  and  Z^  = 


1,2  1  2 

Z  -  Z  where  Z  and  Z  are  increasing  processes.  If  a  =  EZT  exists,  and  a 

1  1 


and  p  are  not  both  infinite,  then  t  Z  -»a/p  a.s. 


Proof .  By  the  strong  law  of  large  numbers  for  sums  of  independent  variables. 


we  know  that  n  ^T^  -»  p  a.s.  and  n  *Zj  -*  a  a.s.  Thus  (a)  and  (b)  follow  by 

n 


Corollary  4.10  and  Theorem  4.9,  respectively. 


Example  4.13.  Additive  Functionals  of  Regenerative  and  Markov  Processes. 


Suppose  X  =  {X^:  tCR+}  is  a  regenerative  process  over  I^.T^,...  Consider  the 


additive  functional 


(4.8) 


Z.  =  l0  f(x5)dS  *  s 

0<s<  t 


where  f :  E  -»  R  and  g :  E  -*  R .  The  f  (x )  might  be  the  cos  t  per  un  i  t  t  ime  of  X 


I 
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being  in  state  x,  and  g(x,y)  might  be  the  cost  of  the  process  jumping  from  x 

to  y  (assuming  the  sum  is  finite).  Then  would  be  the' total  cost  up  to 

time  t.  We  can  write  =  Z*  -  Z^ ,  where  Z^(Zf)  are  the  positive  and 

negative  parts  of  Z (Z*  is  given  by  (4.8)  with  f,  g  replaced  by  F*.  g*) . 

Assume  that  a  =  EZ_  =  Ezl  -  EZ—  exists.  We  can  write 

1  1  1 

(4.9)  a  =  /“  E[f(X  )1(T  >s)]ds  +  2  E[g(X  X  )l(T  >s)] 

U  S  1  0<s<  t  s  s  1 

T1 

=  EE/q1  f(Xs)ds]  +  E[  2  g(Xs_.X  )]. 

s<T1 

Then  from  Corollary  4.12(b)  and  Example  4.8.  we  have 

(4.10)  t  *Z^  -»  a/p  a.  s.  and  t  *EZ^  ->  a/p. 

Expression  (4.7)  also  applies. 

In  particular  suppose  X  is  a  Markov  process  with  countable  state  space 
E  and  transition  rates 

q(x.y)  =  lim  P{X(t+h)  =  y  |  X(t)  =  x)/h.  x.y€E. 
hlo 

Assume  that  X  is  irreducible  and  positive-recurrent  with  limiting 
distribution  tt(x).  Then  (4.10)  holds  with  (4.9)  reduced  to 

a  =  2  f (x)tt(x)  +  2  tt(x)  2  q(x.y)g(x.y) 
x  x  y/x 

For  instance,  suppose  /. ^  =  /q!(X  =x)ds.  the  amount  of  time  X  spends  in 

state  x  up  to  time  t.  With  no  loss  in  generality,  we  assume  that  X^  =  x. 

Then  t  ^Z^  -»  ir(x)  a.s.  and  t  ^EZ  -»  tr(x).  Furthermore,  from  (4.7), 

lim[EZc  -  tir(  x)  ]  =  tr(x)[(p2+o2)/(2p)  -  q(x)  1], 
t-v> 

where  q(x)  =  2  q(x,y),  so  q(x)  *  is  the  mean  sojourn  time  of  X  in  stale  x, 

y/x 

and  p  and  cr2  are  the  mean  and  variance  of  the  time  between  two  entrances  into 


state  x. 


5.  STATIONARY  POINT  PROCESSES 


In  this  section  we  discuss  a  few  basic  properties  of  stationary  point 
processes  on  R.  These  concern  their  infinitesimal  behavior  and  Palm 
distributions  (a  conditional  distribution  of  a  process  given  it  has  a  point 
at  a  certain  location).  Our  coverage  does  not  include  ergodic  theorems, 
spectral  analysis,  and  prediction  and  filtering.  As  for  applications, 
stationary  point  processes  with  marks  have  been  especially  useful  in 
characterizing  non-Markovian  stationary  queueing  processes  (Franken  et .  al 
(1981)  and  Baccelli  and  Bremaud  (1987)). 

5.1.  Definitions  and  Examples 

A  stochastic  process  X  =  (X^:  tCR)  with  a  general  state  space  E  is 

stationary  if  (Xt  +h . Xf  ■  =  (Xt  . Xt  ),  for  each  h.tj . t  in  R. 

1  n  '  l  n 

That  is.  the  distribution  of  X  is  invariant  under  translations  of  the  time 

axis.  A  simple  way  of  expressing  this  is  that  0,X  =  X  for  each  h  €  R,  where 

n 

0^X  is  the  process  X  with  the  time  axis  translated  by  h,  i.e. 

9h^(l)  =  X(t+h),  t  €  R.  Stationarity  of  point  processes  is  similar.  A  point 
process  N  on  R  is  stat ionary  if 

(N(B,  +  h) . N(Bn  +  h))  i  (N(B1) . N(Bn))  for  each  B  . B  in  «.  h  €  R. 

In  other  words,  the  increments  of  N  are  stationary  or  invariant  in 

distribution  under  time  translations.  Simply  staled.  0,N  =  N  for  each 

h 

h  €  R.  where  O^N(B)  =  N(B  +  h) ,  which  is  the  process  N  with  the  time  axis 
t  runs  lilted  by  h.  litis  notion  readily  extends  to  point  processes  on  R  ,  R^ 
or  on  other  groups  or  semigroups.  We  shall  restrict  our  discussion  to 
processes  on  R.  Recall  the  convention  tliat  the  [joint  locations  of  N  are 


labeled  such  that 


v*» 


MUM l« 
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...  <  T.j  <  T0  <  0  <  Tj  <  T2  <  ... 

We  have  already  discussed  some  stationary  point  processes:  Poisson  and 

compound  Poisson  processes  with  constant  rates,  and  Cox  processes  with 

stationary  intensity  processes.  Here  are  some  more  examples. 

Example  5.1.  Stationary  Renewal  Processes.  Let  F  be  a  distribution  with 

F(0)  =  0  and  finite  mean  p.  Suppose  N  is  a  point  process  on  R  with 

independent  inter-point  distances  such  that  each  W  .  n  *  1.  has  the 

n 

distribution  F  and  -  Tq  is  such  that  -Tq  and  have  the  joint 

distribution 


P{-T0  >  u.  Tj  >  v}  =  1  -  p'1  /“+V  [ 1  — F ( t ) ]d t . 

In  particular, 

P{-T0  <  t}  =  P{Tl  <  t}  =  p"1  /q[ 1  -  F(s)]ds. 

Then  it  follows  that  N  is  stationary.  This  N  is  called  a  stationary  renewal 
process. 

Example  5.2.  Functions  of  Stationary  Processes.  Many  stationary  point 
processes  arise  as  functions  of  stationary  processes  as  follows.  Suppose  X 
is  a  stationary  process  with  state  space  E  and  N  is  a  point  process  defined 
by  N(A)  =  $(X,A)  where  $ :  x  £  -»  {0,1,...}  and  J  is  the  set  of  sample  paths 

of  X.  Assume  <p  is  such  that 

(5.1)  *(X.t  +  A)  =  ^(G^X.A)  for  each  t.A. 

Then  N  is  stationary.  This  follows  since 

0tN(-)  =  *(X.  t  +  •)  =  *(0tX,  •)  =  *(X.-)  =  N( • ) . 

This  result  also  holds  if  X  is  a  stationary  point  process  or  a  vector  valued 
process.  For  instance,  suppose  X  is  a  stationary  pure-jump  Markov  process  as 
in  Example  4.13  or  1  6.3.  Consider  the  point  process  N  of  times  that  X  jumps 
from  some  x  G  S  to  some  x'  G  S'  where  S  D  S'  =  Then 
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N( A)  =  <*>(X. A)  =  2  1(X  _€  S.  X  €S). 

t€A  1  1 


Clearly  satisfies  (5.1)  and  so  N  is  stationary. 


Another  notion  of  stationarity  is  as  follows.  A  point  process  N  on  R 


has  stationary  intervals  (or  inter-point  distances)  if  the  sequence  . ...W 


W  W  ...  is  stationary:  (W  . W  )  =  (W  . W  )for  any 

0  1  n ,  +h  n.  +h'  1  n,  n,  '  J 


Oj . n^.  h.  If  N  is  stationary,  then  intuition  suggests  that  it  has 


stationary  intervals.  This  is  true  in  only  degenerate  cases.  Indeed,  since 


the  T  ‘s  are  labeled  such  that  T  ,  <  T_  <  0  <  T, ,  then  the  distribution  of  W. 

"  _  1  -  Q  -  I  I 


will  usually  be  different  from  W^,  n^l :  The  is  an  interval  covering  a 


certain  location  0  while  the  other  W  ‘s  have  no  such  restriction.  This  is 

n 


called  the  waiting  time  paradox.  For  instance,  if  N  is  a  Poisson  process 


with  rate  X,  the  is  the  sum  of  two  independent  exponential  random 


variables  -Tq  and  T^  both  with  mean  X  .  while  any  other  is  simply 


exponential  with  mean  X  The  Palm  probabilities  in  5  5.3  shed  light  on 


this  paradox. 


5.2.  Infinitesimal  Properties 


For  the  following  discussion,  we  assume  that  N  is  a  stationary  point 


process  on  R.  It  need  not  be  simple.  An  application  of  Fubini's  theorem 


(Chung  (1972))  shows  tl>at  P(N((t})  =0}  =  1.  for  each  t.  Moreover,  either 


EN(I)  <  00  for  each  finite  interval  I,  or  EN(I)  =  00  for  each  non-degenerate 


interval  I.  In  either  case. 


EN  =  lEN, .  t  >  0. 

t  1 


where  EEN  ^  This  follows  since,  by  the  stationarity  of  N. 


F.N  =  EN  +  H(N  -  N  )  =  EN  +  EN  .  s.  t  >  0. 
s+t  s  s+ t  s  s  t 


.  *  *  ^  ■  •  ■**  ,  '*■ 
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When  N  is  a  Poisson  process  with  rate  X,  then  we  know  that 


(5.2) 

(5.5) 

(5.4) 


P{Nt  >  1}  =  Xt  +  o(t)  as  t  1  O.  * 


X  =  EN  . 


P{ N L  >  2}  =  o(  t)  as  t  i  0. 


Does  each  stationary  process  have  an  ''intensity"  X  as  in  (5.2)?  If  so.  does 
X  always  equal  EN^?  A  process  satisfying  property  (5.4)  is  called  order ly . 
Lemma  1.7  ensures  that  if  N  is  orderly,  then  it  is  simple  and  so  one  can 
order  its  point  locations  (they  are  "orderly").  When  is  N  orderly?  The 
following  result  addresses  these  issues. 

Theorem  5.3.  (a)  (Khintchine)  The  limit  X  =  lim  P{N  >  l)/t  exists  and 

t-O  c 

0  <  X  <  “. 

(b)  (Korolyuk)  If  N  is  simple,  then  X  =  EN^  <  ®. 

(c)  (Dobrushin)  If  N  is  simple  and  ENj  <  “.  then  N  is  orderly. 

Proof  (a)  Clearly  f(t)  =  P{N^  >  1)  decreases  to  0  as  t  i  0  and.  for  each 


s. t  >  0. 


f(s  +  t)  =  P{Ns  >  1}  +  P{Ns  =  0.  Ns+i  >  1}  <  f(s)  +  f(t). 


Thus.  X  exists  by  the  following  property  of  sub-additive  functions:  If  f: 

[0 .  b]  -»  R  is  sub-add  itive  ( f  (s+t  )  <  f(s)  +  f  { t ) .  s.t  >  0)  and  f  ( t )  -*  0  as 
t  -»  0.  then 

lim  f (  t ) / 1  =  sup  f(t)/t  <  00 . 
tlO  t 

(b)  First  note  that  since  N  is  simple  (its  points  are  isolated),  we  can  write 

Nj  =  lim  a.s..  where  S  =  >.'n  l(N((k-l)/n,  k/n]  >  I)  and  n  runs  through 

n-*°  n  n  k^O 

integers  of  the  form  2m.  Tlien  by  l.ebesque's  monotone  convergence  theorem  and 
part  (a) .  we  have 


EN,  =  lim  ES  =  1 im  nf ( 1/n)  =  X. 
1  n 

n-w  n-w 
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(c)  Using  the  stationarity  of  N.  we  can  write 
EN.  =  nEN(0, 1/n] 

CO 

=  nf ( 1/n )  +  nP{N(0, 1/n]  >  2]  +  n  2  P{N(0.1/n]  >  k} . 

k  =3 

Letting  tv10,  we  know  by  (a)  and  (b)  that  nf(l/n)  -»  ENj  .  and  so  the  last  two 
terms  in  the  preceding  display  must  tend  to  0. 

What  can  we  say  about  the  distribution  of  the  number  of  points  at  a 
single  location  (or  in  a  batch)  when  N  is  not  simple?  In  case  N  is  a 
compound  Poisson  process  with  rate  A  and  mass  or  batch-size  distribution  F. 


P{  I  i  N  <  m}  =  AF(m)t  +  o(t)  as  t  1  0,  and 

F (m)  =  lim  P{N  <  m  |  N  >  1} . 

tiO 

These  properties  extend  to  the  general  stationary  point  process  N  as  follows. 
Theorem  5.4.  For  each  m.  the  limit  A  =  lim  P{1  <  N  <  m}/t  exists  and  A  ( 

m  t  |o  C 

some  A  <  «>.  When  A  <  °°,  then 


(5.5) 


F(m)  =  A  /A  =  lim  P(N  <  m  |  N  >  1) 
tiO  1  ‘  1  ' 


and  EN^  is  the  mean  of  F. 

Proof .  The  first  assertion  follows  like  Theorem  5.1  (a)  since  g(t)  =  P{ 1  < 
N  <  m)  is  sub-additive.  The  existence  of  the  limit  (5.5)  follows  by 
applying  the  first  part  and  Theorem  5.1(a)  to  the  conditional  probability 
P{  1  <  N  <  m)/P(Nt  >  1).  That  EN  is  the  mean  of  F  follows  by  an  argument 
similar  to  that  for  Theorem  5.1  (b),  which  we  omit. 

Extensions  5.5.  All  of  the  preceding  results  hold  under  the  weaker 
assumption  that  N  is  crudely  stationary:  N(I+t)  =  N(I)  for  each  t  and 


interval  I  (see  Chung  (1972)).  Korolyuk's  result  extends  to  non-s tat  ionary 
point  processes  that  may  also  be  on  a  general  space.  For  this  and  other 


S  s 
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insights  into  these  infinitesimal  properties,  see  Leadbetter  (1972),  Daley 
and  Vere-Jones  ( 19SS)  and  their  references. 

5.3  Palm  Probabilities 

A  Palm  probability  distribution  of  a  point  process  is  essentially  a 
conditional  probability  distribution  of  the  process  given  that  it  lias  a  point 
at  a  certain  location.  Such  probabilities  shed  light  on  inter-point 
distances.  For  instance,  a  stationary  point  process  on  R  will  have 
stationary  intervals  with  respect  to  its  Palm  probability  even  though  it 
doesn't  have  stationary  intervals  with  respect  to  the  underlying  probability 
measure . 

I 

j  We  begin  by  defining  Palm  probabilities  for  non-s tat  ionary  processes. 

|  Suppose  N  is  a  point  process  on  E  =  R  whose  mean  measure  p( A)  =  EN(A)  is 

finite  for  bounded  A.  Let  A  denote  the  set  of  all  counting  measures  on  E. 

The  Campbell  measure  of  N  is  a  measure  C  on  E  x  A  defined  by 

C( A  x  M)  =  E[N( A) 1 ( N  €  M)].  for  A.M  Borel  sets  in  E.  A. 

This  measure  admits  the  disintegration 
:  (5.6)  C(A  X  M)  =  /A  Pt(M)p(dt), 

where  each  P  is  a  probability  measure  on  A  (see  §10  of  Kal ienberg( 1983) ) . 

The  P^  t  €  R,  are  called  the  Palm  probability  distributions  of  N.  This 
definition  is  essentially  that  of  Ry 1 1-Nardzewski  (1961)  who  gave  a 
theoretical  basis  for  earlier  versions  of  this  notion.  Note  that  expression 

(5.6)  is  equivalent  to 

(5.7)  P  (M)  =  C(d  t  x  M)//i(dt)  =  E[N(dt)l(N  €  M)]/EN(dt). 

We  now  restrict  our  attention  to  the  case  in  which  N  is  stationary  and 
simple  with  \  =  EN^  <  Then  from  the  right-hand  side  of  (5.6),  it  follows 


.  -\ 


> .' 


(y> 

that  P^(M)  =  Po(0_tM),  where  0_tM  =  M  €  M)  and  Q  ^n(A)  =  p(A-t). 

A  €  £.  That  is,  the  P  's  are  translations  of  P^.  Accordingly,  the  single  P^ 

is  called  the  Palm  probability  distribution  of  the  stationary  process  N.  In 

this  case,  the  preceding  definition  of  Pq  is  expressed  as 

(5.8)  Pq(M)  =  (X|Af 1  E[/a  l((0H  C  M)N(dt)]. 

where  | A |  is  the  area  of  A  €  £.  The  right-hand  side  is  the  same  for  each 

ACS,  and  so  A  =  (0,1]  is  a  typical  choice.  Another  expression  for  the  last 

expectation  is  2  P{0^.  N  €  M,  T^  €  A) . 
n  n 

Following  a  common  convention,  we  let  N°  =  2  6^.0  denote  another  point 

n  n 

process  on  R.  on  some  probability  space,  such  that  P(N°  C  M)  =  P^(M)  f°r  eac^ 
M.  This  probability  measure  upon  which  N°  is  based  is  not  the  same  as  the  P 
we  have  been  using  for  N.  The  distinction  between  these  probabilities  should 
be  apparent  from  the  events  they  measure.  The  N°  is  interpreted  as  "N 
conditioned  that  it  has  a  point  at  0"  (the  Palm  version  of  N).  This 
interpretation  is  justified  by  the  property 

P{N°(a.b]  =  m)  =  lim  P{N(a,b]  =  m  |  N(-h.  0]  >  1). 

hio 

Furthermore,  note  that  Pq{m:  m{0)  =  1}  =  1  or  N°{0)  =  1  a.s.  This  follows 

since  using  (5.S)  with  A  =  (0,1]  and  0  N { 0 }  =  N(T^}  =  1  a.s.,  we  have 

n 

P{N°{0)  =  I)  =  A"1  2  P{  0T  N {0}  =  I.  Tn  <  1} 
n  n 

=  A_ 1  2  PIT  <  1}  =  A-1  EN.  =  1. 

'  n  ’  1 

n 

Another  feature  of  is  that  it  has  stationary  intervals  (even  though  N  does 
not  have  stationary  intervals).  This  statement  is  equivalent  to 
Pg(9j  M)  =  P^(M).  for  each  M.  which  one  can  prove  using  (5.8). 

The  following  formulas  relating  P  and  P^  are  useful  for  proving  results 
abou  t  o  r  N . 


Campbell  Formula.  For  R  x  A  -»  R 

(5.9)  \Ei>(t.N0)]  =  F.[/r  ♦(t.9tN)N(dt)].  * 

provided  these  expectations  exist.  This  follows  from  (5.5)  when  <p  is  a 
simple  function  and.  for  a  general  <p  (which  is  a  limit  of  simple  functions), 
it  follows  by  monotone  convergence.  A  special  case,  for  f:  A  -»  R  is 

X  E[ F ( N° ) ]  =  E[ /q  f(OtN)dt]. 

Keep  in  mind  that  the  expectation  on  the  left  is  with  respect  to  the 
probability  for  N°  while  the  expectation  on  the  right  is  with  respect  to  the 
probability  for  N,  which  is  different. 

Expressing  P  in  Terms  of  Pq.  For  f :  A  -*  R+. 

T°  _T° 

E[f (N) ]  =  X  E[/01.f(TtN°)dt]  =  X  E[/0  °  f(T_tN°)  dt]. 

In  particular, 

T° 

P(N  €  M}  =  X  EC/q1  l(TtN°  €  M)dt]. 

A  special  case  is  the  Pa lm-Kh inchine  formula 

P(N(0,t]  =  m)  =  X  /“  P{N°(0. s]  =  m)  ds. 

Also,  letting  F(t)  =  P(T^  <  t).  we  have  (cf.  Example  5.1) 

(5.10)  P{-  Tq  >  u.  Tj  >  v}  =  1  -  X  /JJ+V  [1  -  F(t)]dt 

P(-T0  <  t)  =  P(T1  <  t)  =  X  /*  [1  -  F(s)]ds. 

Our  next  result  is  a  convenient  formula  for  the  Palm  probability  of  a 

superposition  of  processes.  Suppose  . are  independent,  simple 

stationary  point  processes  on  R  with  finite  intensities  X^ . X  .  Consider 

their  superposition  N  =  Nj+...+Nn.  Clearly  N  is  stationary  since  it  is  of 

the  form  N(A)  =  <p(X,\)  where  X  =  (N^ . N^)  is  stationary  (recall  Example 

5. 2) .  and  N  is  simple  wi th  rate  X  =  X,  +  . . . +X  since  N  .  ( t }  =  0  a. s.  for  each 
j.t  and  the  Nj . are  independent. 


Theorem  5.6.  For  M€jV, 


(5.11) 


P{N°€M>  =  2  (X./X)  P{  N°  +  X  N  e  M) . 
j=l  J  J  k/j 


where  the  N.,  N,  .  k^j  are  independent. 
J  * 


In terpre  tat  ion .  This  says  that  N°  is  distributed  as  N°  +  2  N  with 

j  ^  k 


probability  X^/X.  j=l . m  (ie.  N°  is  a  "mixture"  of  these  processes).  T 


N  ,  N  k/tj  on  the  right  of  (5.11)  are  defined  on  some  probability  space  and 
J  F 


their  distributions  are  the  same  as  the  original  processes  with  the  same 
labels . 

Proof .  Two  applications  of  the  definition  (5.8)  and  the  stationarity  of 


N. . N  yield 

1  n 


P(N°€M)  =  X  E[/  1(0  N€M)N(dt)J 

(o.i]  1 


=  X 


-1 


2  E{F.[  /  1(9  N  +  E  O  N  €  M)N  (dt)  |N  k*j]} 

j  =  l  (0.1]  1  J  k*j  k  J 


1  U 

X  2  X.  E[1(N°  +  2  0  N.  €  M). 

j=l  J  J  k*j  1 


.  il 

=  X  2  X.  P{ N°  +  2  N  €  M)/ 
j  =  l  J  J  k/j 


Example  5.7.  Suppose  Nj . N  are  independent  renewal  processes  with 


waiting  time  distributions  K . F  that  have  means  X. 

In  1 


.  X  1'heir 

n 


superposition  N  =  ■••+^n  >s  stationary,  but  it  will  generally  not  be  a 
stationary  renewal  process.  Theorem  5.6  and  (5.10),  however,  tell  us  that 
the  Tq  and  T^  for  N  are  such  that 


n 

P{-T  >  u.  T.  >  v)  =  2  (X  /X)  F  (u)F  (v)  If  Q  (u+v) 

°  1  j=I  J  J  J  k/j  k 


where  6^( t )  =  X^  / 1 [ 1 -F^( s ) ]ds  and  T ( t )  =  1  -  F(  t ) 
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6.  POINT  PROCESSES  CHARACTERIZED  BY  MART  INC  ALES 

We  now  discuss  point  processes  on  R  +  whose  evolution  is  character ized  by 

an  increasing  history  of  observed  events  or  information.  Here  are  some 

motivating  examples.  Suppose  N  =  { N ^ -  t€R+)  is  a  Poisson  process  on  R+  with 

t 

mean  measure  A  =  /  A  ds  (following  the  convention  of  this  area,  we  now  use 
C  0  s 

A  instead  of  A).  One  can  interpret  N  as  evolving  over  time  and  its  evolution 
or  dynamics  are  given  by 

(6.1)  E[dNt  | FtJ  =  P(dNt  =  1  |  F t_ }  =  Atdt  +  o(dt). 

where  dN  =  N  -  N  .  F  =  o(N  .  s  <  t).  the  o-field  of  the  history  of  N  up 

to  time  t.  and  F  is  the  history  on  [O.t).  A  more  concise  way  of  expressing 

(6.1)  is  to  say  that  the  process  =  N  -  A^.  t  €  R+ ,  is  an  -  mart  ingale. 

That  is.  E[M^  |  F^]  =  M^,  s  <  t.  which  is  equivalent  to 

t 

(6.2)  E[Nt  -  Ns  -  /  Audu  |Fs]  =  0. 

s 

t 

As  another  example,  suppose  that  N  is  a  Cox  process  directed  by  A(  =  /()  A^ds 

where  A  is  a  non-negative  stochastic  process.  Then  the  evolution  of  N  is 

also  characterized  by  (6.1),  (6.2),  where  A  is  random  and  F  =  o(N^,  s  <  t; 

A^,  u  >  0) ,  the  o-field  of  N  up  to  t  and  the  entire  trajectory  of  A  as  well. 

For  the  final  example,  suppose  that  (X^:  t  €  R+)  is  a  birth  and  death 

queueing  process  with  state  space  (0.1,...)  and  s tate-dependen t  arrival  and 

service  rates  a(n).  P(n).  That  is.  when  =  n.  the  time  to  the  next 

potential  arrival  is  exponential  with  mean  tr(n)  *  and  the  time  to  the  next 

potential  service  completion  is  exponential  with  mean  P(n)  .  Consider  the 

point  process  of  the  number  of  customer  arrivals  up  to  time  t.  Again,  the 

evolution  of  N  is  characterized  by  (6.1),  (6.2)  with  A  =  a(^t_)  :inc^ 

F  =  a(X  :  s  <  t).  the  history  of  X  up  to  t.  which  also  includes  that  of  N  up 
t  s  “ 


( 


4 


i 

i 
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to  t.  This  is  sometimes  referred  to  as  a  state-dependent  Poisson  process 
with  random  intensity  \  (be  careful  with  this  loose  terminology  since  N  is 
generally  not  a  Poisson  or  even  a  Cox  process). 

Such  examples  motivated  the  development  of  a  general  theory  of  point 
processes  with  dynamics  as  above.  The  link  between  these  point  processes  and 
their  associated  martingales  has  led  to  a  martingale  calculus  of  point 
processes,  which  is  part  of  the  modern  stochastic  calculus  that  deals  with 
integration  with  respect  to  Weiner  processes,  martingales  or 
semi -mar t ingales .  Point  processes  on  R+  are  special  submartingales  or 
semi -mar  t i ngales . 

Much  of  the  current  mathematical  research  on  point  processes  deals  with 
this  class  of  processes  Little  is  known  about  these  processes  on  or 
other  partially  ordered  spaces:  see  for  instance  Merzbach  and  Nualart  (1986). 
There  are  a  number  of  results  in  this  area,  such  as  in  filtering  and  optimal 
dynamic  control,  that  have  potential  applications  in  operations  research. 
Basic  references  are  Bremaud  (1981),  Liptser  and  Shiryayev  (1978),  Ikeda  and 
Watanabe  (1981).  and  Karr  (1986).  Unfortunately,  we  cannot  get  into  these 
lengthy  topics.  We  will  be  content  with  introducing  the  basic  notion  of  a 
compensator  and  showing  how  it  is  used  in  Poisson  limit  theorems  and 
approx imat ions . 


I 


y 


6. 1  Compensators  of  Point  Processes 

As  one  would  expect,  the  stochastic  process  A(  appearing  in  the 
martingale  M ^  -  A^  in  the  examples  above  plays  an  important  role  in 

characterizing  N.  Such  processes,  called  F  -compensators  of  N.  are  the 
subject  of  this  subsection. 


■nt.TL.-t 
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Lei  (0.  F,  P)  be  a  probability  space.  This  will  be  the  underlying  space 

for  all  of  our  processes.  Let  {F  :  t€R+)  be  a  1'  i  1  t  rat  itfn  or  history  on 

(Q.  F) ■  a  family  of  sub-a-fields  of  F  that  tire  increasing  (F  C  F  s  <  t  ) . 

The  F  represents  the  information  one  observes  up  to  time  t.  We  assume,  as 

usual,  that  F^  contains  all  P-null  events  and  that  F^  is  right -con t inuous 

(F  =  H  F  ).  Suppose  X  =  {X  :  t€R  }  is  a  real -valued  stochastic  process  on 
1  u  >  t  U  1  ^ 

(Q,  F.  P).  The  internal  history  of  X  is  F^  -  u(X  :  s< t ) .  the  a- field  of  the 

X 

events  of  X  up  to  time  t.  The  X  is  F -adapted .  if  F^  C  F;  for  each  t.  The  X 
is  F^-pred ic  tabl e  if  it  is  F^-adapted  and  each  set  {(t.u)  €  R+  x  Q: 

Xt(w)  <  x}  is  in  the  smallest  a-field  on  R+  x  0  that  contains  the  sets 
(s.t]  x  B.  s  <  t,  B  €  F^_ .  For  our  purposes,  one  can  define  X  as  being 
F^-predictable  if  it  is  F^-adapted  and  has  left-continuous  paths  (such 
processes  form  a  large  class  of  predictable  processes).  The  process  X  is 
increasing  if  X(0)  =  0  and  its  sample  paths  are  nondecreasing  and 
r igh  t-cont inuous . 

Consider  a  point  process  N  =  {N^;  t€R+}  defined  on  (iJ,  F.  P)  that  is 
F^-adapied  and  has  point  locations  Tj  <  T^  < .  .  .  with  T^  -»“a.s.  For 
convenience,  we  assume  that  each  N ^  lias  a  finite  mean  (this  allows  us  to  use 
martingales  instead  of  more  general  local  martingales).  Then  there  is  an 
increasing  F ^-pred ic tabl e  process  A  =  {A(,  eCR+)  such  that,  for  each 
F  -predictable  process  C  --  (C(  :  t  t.  R+ } . 

00  1  r  n> 

(<> .  \)  K  f  C  dN  r  v  \  C  d,\ 

0  '  1  J  ()  1  ' 

The  A  is  unique  up  to  P-null  events.  This  process  A  is  the  F  -compensn t or 
(or  dual  predictable  projection)  of  N .  We  sometimes  call  N  ;ui  F  -  [x>  i n  t 
process  with  compensator  A.  Ihe  condition  ((>  1)  holds  if  and  on  1 y  if  the 

process  M  =  -  A(,  t  C  R+,  is  a  mat  t  ingale. 


Ihe  M  is  the  process  N 
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compensated  by  A.  The  representation  N( =  +  At  is  the  Doob-Meyer 

decomposition  of  N  (viewed  as  a  submartingale).  Keep  irr  mind  that  A  depends 


.N 


on  the  choice  of  F^;  the  smallest  possible  F  is  N's  internal  history  F  . 


The  A  often  has  the  form  A  =  /  A  ds.  where  X  -  { A.  ;  t  €  R  V  is  a 

o  c 


non-negative  F^pred  ic  table  process  called  the  F  stochastic  intensity  of  N. 
This  intensity  has  the  interpretation  (6.1)  and,  in  many  cases. 


X  =  1  i m  FT N  L  -  N  |F  ]/h. 

t  ...  L  t+h  t  1  t J 
li-O 


The  process  N  is  an  F^ -Poisson  process  if.  for  each  s<  t.  N  -  N  isa 

Poisson  random  variable  independent  of  F  .  The  N  has  F  -i ndependent 

increments  if  for  each  s  <  t,  N  -  N  is  independent  of  F 
-  t  s  s 

The  following  are  some  basic  properties  of  compensators- 

(i)  N  is  an  F^-Poisson  process  if  and  only  if  A  is  deterministic  ;ind 

continuous.  In  this  case  K[N  -N  |F  1  =  A  -  A  .  s  <  t. 

L  t  s  1  s J  t  s 

(ii)  N  lias  F  -independent  increments  if  and  only  if  A  is  deterministic. 

(iii)  N  has  F  -condi t ional ly  independent  increments  given  7 .  a  sub-o-field 


of  F^  .  if  and  only  if  A  is  a  fl-measurable  function. 


(iv)  If  A  isa.s.  continuous,  then  N  is  stochastically  conti nous 


(P(dNt  =  1>  =  0.  t  C  R+). 


(v)  If  X  is  an  F  -predictable  process  with  /  |X  I  d  A  <  00  a .  s .  ,  t  C  R  . 

1  [O.t]  s  '  + 


then  the  process  Z  =  /  X  dM  .  t  €  R  is  an  F  -martingale. 

[0. t]  S  S  +  1 


We  ttave  aready  seen  three  examples  of  compensators  of  point  processes  in 
the  introduction.  Here  are  two  more. 


Kxample  6.1.  Renewal  Processes  and  Some  Relatives.  Supjiose  N  is  as  atxive 


,.N 


with  /■  (  =  f>  V  F  where  0  is  some  n-  field  (.  .g.  for  the  Cox  process  above. 


=  a(Xs:  s  C  RJ).  let  K^x)  =  P{Tn+| 


-  T  <  x 


Then  the 


F  -compensator  of  N  is 


■VVV'v- V-  v. 


V  V 


3 


Si 


'j 


r* 


■'A 


■A 


J 


ww k- -.-. -.- ^ s' *.  ».- -*- s- •■ 
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t-r 

n  -i 

A  =  A~  ■»■  /  [1  -  F  { x- )  ]  I-  (dx).  T  <  t  <  T  ,. 

t  T  '  L  n  /J  n  a  n+ L 

n  0 

This  resembles  a  hazard  rate  in  reliability  since  dA...  =  dF  (tl/Tl  -  F  (t-)l. 

n 

In  particular,  if  N  is  a  renewal  process  with  waiting  time  distribution  F  and 
N 

F  =  F  ,  then  the  compensator  is  as  above  with  the  random  F  replaced  by  F. 
t  t  n 

Example  6.2.  Jump  Times  of  Harkov  Processes.  Suppose  X  =  (X^  ;  1  c  }  is  a 

Markov  process  with  countable  state  space  X  and  transition  rates  q(x.y)  (as 

in  Example  4.13).  We  assume  that  0  <  2  q(x.y)  <  ®  and  that  X  cannot  take 

y*x 

an  infinite  number  of  jumps  in  a  finite  time  interval.  A  variety  of  point 
processes  associated  with  jumps  of  X  can  be  modeled  as  follows.  Consider  the 
point  process  N  of  times  at  which  X  jumps  from  some  state  x  to  another  state 
y  where  (x.y)  are  in  the  set  J  C  X  x  X  and  J  does  not  contain  pairs  (x.x). 

Tha  t  is. 


Nt  =  V  l((X  X  )  C  J).  t£R+. 

s<t 

.X 

Then  an  easy  check  shows  that  the  F ^ -compensator  of  N  is 

t 

A  =  /  2  q(x.y)  I (X  _  =  x )ds  t£R  . 

0  (x.y )CJ 

The  X^_  mtiy  be  replaced  by  X^  since  X  is  stochastically  continuous.  These 
point  processes  are  useful  for  model  i rut,  flows  of  customers  in  queueing 
networks  as  we  discuss  later. 

Compensators  for  mtirked  point  processes  are  defined  similarly.  Suppose 

N  =  2  Aj  is  a  marked  point  process  on  R+  x  K  such  that  the  point 

n-1  n'  n 

priHt'ss  N  =  2  l(T  <  t)  is  as  above.  Then  the  compensator  of  N  is  the 
n 

unique  rttndom  measure  A  on  R+  x  E  such  Hint  A^(ll)  =  A([0.t]  x  B)  .  t£R+.  is 

F  -predictable  for  each  B  C  E  and.  for  each  predictable  process  C  =  (C(t,x) 
(t  .x)  C  R+  x  F. }  , 


L.*,  L.‘ 


%  .V' 


i  |V  A*  ■<  >|l. 


E  /  C(t.x)  N(dtdx)  =  K  /  C(i.x)  A(dtdx)  . 
lR  xE  LR  xL 


6.2  Poisson  Convergence  and  Approxima lions. 


Many  properties  of  a  point  process  on  R+  can  lie  expressed  in  terms  of 


its  compensator.  For  instance,  one  might  expect  that  a  sequence  of  point 


processes  would  converge  in  distribution  if  their  compensators  converge 


appropriately.  One  such  Poisson  limit  theorem  is  as  follows.  This  and  other 


limit  theorems  for  processes  with  independent  increments  or  conditionally 


independent  increments  appear  in  Kabanov  et.  al.  (198.1).  and  Kabanov  and 


Liptser  (1981)  (they  also  discuss  marked  point  processes). 


Theorem  6.3.  Let  Nn  be  an  E^-point  process  on  with  compensator  A1'. 


n= 1 . 2 .  and  let  N  be  an  E  -Poisson  process  with  (deterministic  continuous) 


compensator  A.  If  a”  ^  A;  for  each  t.  then  Nn  i  N. 


The  following  total  variation  bounds  are  useful  for  analyzing  rates  of 


convergence  in  the  preceding  setting  or  for  establishing  Poisson 


approximations.  Suppose  N' is  a  point  process  with  E^-intensity  ,V  and  N  is  a 


Poisson  process  with  E^-intensity  A(.  Let  P^  and  P  denote  the  probability 


distributions  of  the  respective  processes  N'  and  N  on  the  interval  [O.t] 


(e.g.  P  (B)  =  P  { N  €  B>  where  B  is  a  llort  1  subset  of  sample  paths  of  N  on 
[O.t]).  The  total  variation  distance  between  P  j  and  P(  (recall  h.  % .  *1 )  is 


defined  by  d(P'.  P  )  =  sup  |  P(B)  -  P  (B) 
t  t  R  t  t 


Total  Variation  Bounds  6.T. 


d(H'  P.)  <  K  /  I  a;  -  A  Ids 

0  s  s 


( i i )  I f  A  =  EA ' ,  t  hen 
'  '  s  s 


d(P‘ .  P  )  <  /  Var  A' 1/2  ds 

t  t  o  s 


1  iTi 


»  V  v  *-•  V 

’  \  %  V-VA  A  A  A  \  *.  ’.  V,  \ 
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(iii)  Using  the  notation  of  §3.J. 

CO 

d(N ' .  Nt)  =1/21  j  P{N;  =  n}  -  P{Nt  =  n> |  <'d(P;.  Pt). 
n=0 

Inequality  (i)  is  proved  in  Brown  ( 1983)  and  Kabanov  et .  al  (1983). 
Inequality  {  i  i  )  follows  from  (i)  since  E  |V  -  KV  |  <  Var  And  (iii) 

follows  from  the  definitions. 

Example  6.5.  Poisson  Approximations  of  Jugp  Times  of  Markov  Processes. 

Suppose,  as  in  Example  6.2,  that  X  is  a  Markov  process  and  N'  is  the  point 

process  of  jumps  of  X  from  x  to  y  where  (x,y)  £  J.  We  observed  that  N‘  has 

X 

h  -intensity  \‘  =  1  q(x.y)  l(X(t)  =  x) .  Assume  that  X  is  stationary 

1  1  (x.y)c; 

with  distribution  tr(x)  =  P(X(  t  )  =  x).  Let  N  be  a  Poisson  process  with 

intensity  A  =  EX'  =  1  q(x,y)tr(x).  Then  from  Bound  6. 4  (i).  we  have 

'  (x.y)C J 

d(P;  .  P)  <  t  -S  q(x.y)E|l(X(t)  =  x)  -  ir(x)  | 

(x.y)c; 

=  2t  S  q(x,y)tr(x)[  1  -  tr(x)]. 

(x.y)C J 

Wlien  the  last  sum  is  small,  then  N'  is  close  to  being  Poisson.  A  specific 
illustration  follows. 

6.3  Customer  Flows  in  a  Jackson  Queueing  Network  That  are  Approximately 
Poisson  . 

We  now  assume  that  the  Markov  process  above  is  an  open  Jackson  queueing 
network  process  defined  as  follows.  Consider  a  network  of  J  nodes 

representing  service  stations.  Ojslomers  enter  tin-  nodes  1 . )  from 

outside  the  network  according  to  independent  Poisson  processes  with 

respective  rates  t>  ^ . t>  ^ .  Each  node  j  operates  as  an  isolated  single 

server  whose  service  limes  are  independent  exponential  rtindom  variables  with 
mean  ♦  *  Customers  are  served  one  at  a  time,  under  any  priority  scheme  A 


customer,  alter  being  served  at  node  j,  goes  immediately  to  node  k  wit! 


probability  p.^.  k=l . .)  •  or  exits  the  network  with  probability  p  ( !> 


t  > 


k=() 


p.,  =  1).  Let  X(  t )  -  (X .  (  t ) . X,(t))  denote  the  numbers  of  customers  at 

J  K  i 

the  respective  nodes  at  time  t.  Then  X  is  a  Markov  process  with  state  space 

,1  ~  { x  =  ( x . x.):  x  .  =0,1....}  and  transition  rales 

1  J  J 


q(x.y)  = 


<  *jpjk 


x  ♦ iPJ0 


for  y  =  y.  +  e  . 

J 


y  =  x  -  e  .  +  e.  ,  x.>l 
J  ^  J  “ 


y  =  x  -  e  . 

J 


and  q(x.y)  =  0  elsewhere,  where  e^  is  the  vector  with  1  in  position  j  and  0's 
el sewhere . 

Consider  the  rout ing  probabilities  {p  }  j . k=0 . J  as  a  Markov  matrix. 

J  K 

where  p^  =  l’p-  Assume  that  this  matrix  is  irreducible.  Then  there  is 

a  unique  solution  a ^ . to  the  so-called  traffic  equations 

J 

"j  -  ".i  *  k:,  W  J=' . '■ 

Namely,  =  q^/>^  t>^,  a.  =  q.  (,j  >  1)  where  q() . q^  is  the  probability 

J 

distribution  satisfying  q  .  =  X  q  p  ..  j-0, . . 

J  k=<)  k  kj 


This  assumption  ensures 


that  there  is  a  positive  probability  t  la  t  each  customer  may  reach  any  node. 

We  also  assume  that  the  traffic  intensity  p.  =  a  ./<f>  <  1  for  each  j.  Thus 

.)  ,1  .] 


the  network  process  X  fas  the  staliotary  distribution  tt(x)  =17  (1  - 

.1=1 


P  .  )p 


x 

.) 


inally.  assume  that  X  is  stationary. 


Now.  consider  the  point  process 


N  (t)  =  X  X  l(X(s-)  =  x.  X(s)  =  x  -  e  +  e  ).  tCR 
•'  s<t  x  ' 


of  the  number  of  times  customers  move  from  nixie  l  to  node  j  in  the  time 


interval  [O.t].  Similarly,  let  N  (t)  denote  the  number  of  limes  customers 

exit  the  network  from  node  i  up  to  time  t.  Also  consider  the  process 

N.(t)  =  2  2  l(X(s-)  -  x,  X(s)  =  x  +  e  .  or  x  -  e .  e  .  for  some  i),  tCR  , 
J  s<t  x  J  ‘  J  * 

of  the  number  of  customer  arrivals  into  node  j  up  to  time  t.  From  Fxample 

X 

G.2.  we  know  that  these  processes  have  the  respective  F  -int ensi t i es 

\j(0  =  1(X.  ( t)  >  l)*.p. ..  and  AJ(  t  )  =  tlj  ♦  2  l(X.(t)  >  l^p.  .. 

Since  X  is  stationary,  it  follows  that  N  and  are  stationary  with  rates 

FX  .(t)  =  p  ,  $ .  p .  .  =  a  p .  . 
ij  i  i  U  i  tj 


F'  A  (  t  )  -  n  .  +  i'  p.  $  p.  .  =  a  .  . 

J  J  j  1  »  ij  J 

It  is  well  known  that  are  independent  Poisson  processes  (in 

the  usual  sense  when  only  their  internal  histories  are  observed  ;ind  X  is  not) 

with  the  respective  rates  a  [Pjq . a  jP  This  follows  usinu;  filtering,  or  a 

reversibility  argument ;  see  for  instance  Bremaud  (1981)  Similarly,  one  c;ui 
show  tliat  if  l.  ]  are  two  disjoint  subsets  of  nodes  such  that  from  any  node 


in  J  a  customer  cannot  reach  a  node  in  I,  then  (N.  ^),  iCI.  j <J,  are 

independent  Poisson  processes  with  respective  rates  (n.p.  .}. 

X 

We  now  consider  N.  .  as  an  F  -point  processes  (i.e.  X  as  well  as  N  is 
ij  t  i.l 

observed)  (Xir  interest  is  in  how  close  N.  .  is  to  be  i  tin  Poisson  let  d* 

1  .)  i  .1 

denote  the  t  ot  al -var  ia  t  i  on  distance  lie  t  ween  the  distribution  of  N  and  that 

i  .1 

of  a  Poisson  process  with  rate  o . p .  ^  on  [O.t].  Ihen  by  the  Round  0.1  (t).  we 


have 


■  *.•  t  |  |  |  «  |  ».■  i.fJLa  t 


K 


d'  <  /  E  | X  As)  -  E  X  (s)  J  ds 


=  t  *.p  E  1 1 (X. ( t )  >  1)  -  p.  | 


=  2 1  $ .  p  .  .  p .  ( 1  -  p.)  =  2 ta . p .  . ( I  -  p.). 
i  i j  i  i  i  ij  i 

Thus  N.j  will  be  approximately  Poisson  when  the  traffic  into  i  is  lii^ht 
(Pj  =  0).  the  traffic  into  i  is  heavy  (p^  =  1).  or  the  traffic  between  i  and 
j  is  1 ight  (a. p.  =  0) . 

Similarly,  let  d^  denote  the  total-variation  distance  between  the 

distribution  of  N.  and  that  of  a  Poisson  process  with  rate  a.  on  [0,t], 

J  J 

Then .  as  above,  d.  <  2 1 X  <£.p.  p.(l  -  p.).  Consequently.  N  will  be 
.1  .  l  i,|  r  l  ^  J  j 

approximately  Poisson  under  the  conditions  above  or  when  the  network  is  laru;e 

and  the  dispersion  of  customers  via  the  p.  .  's  is  relatively  even  (the  p.  's 

are  approximately  equal  and  small).  Brown  and  Pol  let t  (19S2)  discuss  this 

approximation  and  related  ones  for  closed  networks  (they  sometime  use  the 

looser  Bound  G.T(ii)  instead  of  (i)  for  convenience). 
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